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ABSTRACT 

The purpose of this study was to develop, validate, 
and describe indicators of educational disadvantage to be used in 
Australia to identify .schools and students . most in need of assistance 
from the Disadvantaged Schools Program* Initially , a detailed review 
was prepared of the resource allocation responses which have been 
made in Australia to the changing^ concept of equality of educational 
opportunity* Next a theoretical model was developed which was' 
designed to quantify the optimal level of precision with which these, 
responses could be used to allocate resources/ The data obtained from 
a national study conducted during 1975 of the educational 
achievements of Australian . lO^year^old and 14-year-old students in 
the areas of reading, writing, and numeration were ther< used to 
develop criterion and validation measures for the construction of 
indicators of educational disadvantage* These data were combined with 
data from the 1971 Australian Census of Population and Housing which - 
provided detailed descriptions of the students 'neighborhoods .These 
combined data were divided according to age level and aggregated over 
schools . Following an analyses of indicator characteristics, the 
indicator with the best overall performance was examined with respect 
to the dimensions of residential differentiation associated with the 
Shevky-Bell model ♦ It was demonstrated that neighborhoods associated * 
with educationally disadvantaged schools were characterized hy an 
overlapping network of social features associated with the 
socioeconomic status , ethnicity, and family living arrangements of 
the community* (RM) r 
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CHAPTER 1 
INTRODUCTION 
Educational Means and Social Efids 



In recent times the concept of •equality' has become a central issue in 
debates concerning the provision and distribution of resources in education. 
However the goal of equality of educational opportunity has o. "ten not been 
treated as a goal in itself but as a means for obtaining certain long-range 
social goals. This instrumentalist interpretation appears to have emerged 
from the view that* in modem society s education has been seen as the 
'social distributor of life chances 1 (Halsey , 197213), 

Rather than taking direct action to rearrange 'life chances 1 , govern- 
ments in Western countries have generally opted to use the education system 
as an indirect and politically more defensible means of achieving social ■ - 
reforms. Confidence in this approach reached its zenith in the United 
States during the early lf?60 ! s when President Lyndon Johnson launched his 
•War on Poverty* with the following statement* 

This is going to be an education programme. We are going to 
eliminate poverty by education* and I don't want anybody to 
mention income distribution. This is not going to be a handout, 
this is going to be something where people are going to learn 
their way out of poverty, [Quoted from Ashline s 1976) 

The educational attack on poverty in the United States was most > 
strongly related to the passing of the Elementary and Secondary Education 
Act in 1965, This legislation resulted in the commencement of the "Title I" 
programs which were aimed specifically at children who were disadvantaged 
because of 'poverty 1 , 

The urge to seek educational solutions to social problems has also 
emerged in the United Kingdom and Australia* and programs have been developed 
which have overtly been designed' to assist students living in 'deprived 
areas 1 or students attending 'disadvantaged schools'. Generally this has 
been expressed^ in a view of the school as a key agent for breaking the 
'cycle of -poverty' . 

In the United Kingdom the Plowden Report Tecommended that the educat- 
ional needs of students living in 'deprived areas 1 would best be satisfied 
by directing supplementary government funds to schools' in 'Educational 
Priority Areas', Schools in these areas were described as being both agents 
and vi ctim s in the 'vicious ci^cle* , of deprivation, ■ - 



Thus the vicious circle may turn from generation to generation 
and the schools play a central part in the process, both causing 
and suffering cumulative deprivation, (Plowden, 1967 :5Q) 

Similarly, the Karmel Report in Australia recommended that students 
who attended 'disadvantaged schools* should be assisted by providing 
supplementary government funds for schools nominated to participate in__the._ 
'Disadvantaged Schools Program 1 * In this program schools were preferred to 
students 1 families as a point of attack on the 'cycle of poverty* . 

The school provides a practical point of attack on the cycle of 
poverty, for it is a social institution more amenable to change 
than is the family, and an institution where deliberate social 
intervention is acceptable, (Karmel, 1973:94) 

A report prepared by the Organization for Economic Co-operation and 
Development (OECD, 1979} has suggested that, at a very general level, the 
.arguments supporting the use of educational systems as instruments of social 
reform have proceeded in three main steps: 

1. Poverty and school achievement appear to be very closely 
linked; 

2. Economic and social mobility as well as life chances -appear 
to be rather closely related to educational attainment^ 

3. Thus, concentrated effort, by way of increased funding for 
improved and/or increased schooling for disadvantaged 
children, should break the poverty cycle, (OECD, 1979:11) 

The validity of this line of argument has been strongly challenged by 
two major studies carried out in the United States by Coleman et al (1966a3 
and Jencks et al (19723. These reports presented analyses which have 
suggested that variations in school resources had a relatively small impact 
on variation in educational achievement and attainment. Similar findings 
have been reported by Little and Smith (19713 following a wide ranging 
review of educational programs for disadvantaged students in the United 
States, and also by the researchers involved in the cross -national studies 
of educational achievement carried out by the International Association 
for the Evaluation of Educational Achievement (for example. Comber and 
Keeves , 1973) . 

More recently, hopes for educational solutions to social problems were 
further damaged following the publication of the report describing a large 
scale evaluation of the 'Follow Through 1 compensatory education program in 
the United States (Stebbins et al , 1977), This evaluation followed 20,000 
students over a four year period in order to examine the effectiveness of 
seventeen different models of ccmpensatory action. The researchers; 



concluded thcit 'none * the seventeen models in the evaluation demonstrated 
that it could compensate consistently for the academic consequences of poverty 1 
and that the overall Follow Through strategy was 'not an effective tool for 
raising poor children's test scores* (Anderson gt__Jtl , 197S:162). 

All of these studies have been subjected to a great deal of discussion 
mA rritiri with respect to their methodologies (Hosteller and Moynihan, 
1972; Levine and Bane, 1975j Hodges, 1978; House et al, 1978; Wisler et al ^ 
1978), Much of this debate has been concentrated upon the technical problems 
in these studies which have occurred because they were carried out in 
'naturalistic 1 settings rather than us true experiments s and also upon the 
assertion that the educational outcome measures which were employed focussed 
too narrowly on an academic view of the purposes of schooling. A further 
problem associated with these studies^ has been that they have concentrated 
on short term effects - whereas an assessment of educational effects on social 
reforms requires the development of longitudinal studies* These studies would 
be able to consider the long term influences of educationjyL^f feets on the 
total 'life chances 1 of students in a more comprehensive fashion. 

The Use of Indicators to Allocate Educational Resources 

An important issue in the implementation of educational programs designed to 
achieve social goals has been the selection of procedures by which educational 
resources have been distributed among schools and students. The effectiveness 
of these programs would obviously be expected to have limited impact umeb"" 
these procedures were able to identify accurately the schools and students 
which the programs were designed to assist s 

The three educational programs in the United States, United Kingdom and 
Australia , described in the previous section, have all relied upon the use of 
indicators constructed from objective data to identify appropriate 1 targets 1 
for the allocation of supplementary government assistance. The target groups 
for each of these programs have been .described in different ways. In the 
United States the program was concerned with children living in 'poverty* , in 
the United Kingdom the aim was to assist students attending schools in 
'deprived areas 1 , .while in Australia the focus was on students attending 
'disadvantaged schools 1 . 

The various definitions of target groups for these programs have been 
accompanied by a variety of approaches to the construction of indicators, to 
assist with the objective identification of the target groups. 
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In the United States the allocation of Title I funds has been based on 
purely economic criteria in order to provide assistance for f the special 
needs of children of low-income families and the impact that concentrations 
of low-income families have on the ability of local educational agencies to 
support adequate educational programmes 1 (United States House of Represent- 
atives, 1978}. The indicator used to operationalize this definition has 
been based on a 1 count 1 of poor children derived from census data according 
t© the following categories (United States Department of Health, Education 
and Welfare, 1976)* 

1. Children aged 5 to 17 years from families designated as 
"poor" according to the Grshansky (19653 formula applied 
to the 1970 eensus'r -~— — =- ------- __=- . . = 

2. Two -thirds of the children aged 3 to 17 years receiving 
payments under the Aid to Families with Dependent Children 
(AFDC) programs. 

3. Children" aged 5 to "17 years being -supported by - public funds 
who live in foster homes or in institutions for neglected" 
or delinquent children. 

After 1980 the basic allocation formula will take account 
of 10Q per cent of children from families receiving AFDC instead 
of only two-thirds 3 which has been the. provision since 1965, 
Also, a further supplement will be made to the Title I basic 
funds according to the number of families in each State with 
incomes below the national median figure* (QECD, 1979} 

This indicator has been used to allocate funds among States* Within 
States the allocations to school districts and then schools within school 
districts has been made by using a variety of indicators which have 
similarly been based on estimates of povervy 'counts 1 (Blackburn s 1979a). 

The Plowden Report (Plowden, 1967) in the United Kingdom emphasized 
that the identification of schools in Educational Priority Areas^ should be 
based on objective data. The National Survey carried out for the Plowden 
Report had demonstrated that parental attitudes were of prime importance in 
explaining variation in the educational achievement of students. However s 
it was reasoned that there might be validity problems if a complete census • 
of parental attitudes was undertaken when the purpose for collecting the 
data became public knowledge, Instead, the Plowden Report listed eight 
criteria which were assessed as being suitable for identifying 1 those places 
where educational handicaps are reinforced by social handicaps?: occupation, 
size of family , social welfare payments 4 overcrowded living conditions, poor 
school attendance rates, proportions of handicapped persons f incomplete 
families, and children unable to speak English; (Plowden, 1967:57-59), The 
responsibility for the construction of an appropriate, indicator was given to 
the Local Education Authorities^ 
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Various attempts were made by Local Education Authorities to use these 
criteria to construct suitable indicators. However, anomalies arose between 
and within ureas because of the types of criteria which were used and the 
weightings given to particular measures in the construction of the indicators 
(Halsey, 1972:46-47), The most widely accepted attempt at indicator 
construction was carried out for the Inner London Authority by Little and 
Mabey [19713 * This index consisted of ten measures? occupation 4 children 
receiving free meals, overcrowded housing, lack of housing amenities * handi- 
capped children, immigrant children, teacher turnover, pupil turnover* 
absenteeism, and family size. The measures were standardized according to 
a form ula base_d_on the range of each measure and then added together with 
equal weights to form the indicator (Halsey, 1972:50), 

The measures used in the construction of this indicator were derived 
from various sources. The occupations overcrowded housing * lack of house 
ameni ties , and family size measures were obtained from census dataj the 
children receiving free meals s immigrant children, ^a^cher^turno^er^pupil -—^= 
turnover, and absenteeism measures were derived from various government 
department records; and the handicapped children measure Was based on the 
percentage of children of lew ability at the 11+ transfer to secondary schools 

The Karmel Report in Australia examined several approaches to the 
identification of schools for participation in the Disadvantaged Schools 
Program: subjective assessment based on information obtained from informed 
persons within Australian school systems, and objective assessment based on 
the construction of indicators from census data. The former approach was 
rejected because there would have' been a lack of inter-system comparability 
Tn" _ tH^ifrf5rina"t"ion obtained from each education system. 

The initial 1973 national indicator, derived from a range of census data 
describing occupations , ethnicity, education* family characteristics, religion 
and housing, was intended to identify 1 schools drawing a high proportion of 
enrolments from neighbourhoods having certain characteristics known to be 
generally associated with a low capacity to take advantage = of educational 
facilities 1 (Karmel, 19.73 : 92) . More recently the 19S0 national, indicator 
has only been used to divide funds between school systems who have then ^ 
employed their own infiUators to allocate fundi? to schools. The structure of 
the national and system-level indicators have been described in> detail in a 
later chapter. 

In the United: States and the United Kingdom there has been criticism 
relating to the degree of precision with which resources allocated by the 



indicators used In the Title I aflrd Educational Priority Areas programs 
have reached those students who were in most need of assistance. Class 
(1970) and Fortune^J^97l) showed that an income dichotomy for famCiy incomes, 
as was used in the Title I program indicator, was a very imprecise method 
for ^ identifying- students having reading and learning difficulties. Similar 
concerns have been expressed about the lack of precision of the Educational 
Priority Area indicators following research studies carried out by Acland 
(liljl) and Barries and Lucas (1974) . In Australia there would appear to have 
been no research studies which have systematically examined the precision 
with which resources allocated by indicators used in the Disadvantaged 
Schools Program have reached students who were in most need of assistance. 

The Purpose of This Study "" 

The previous discussion has raised two important issues concerning the use 
of**educational programs to achieve social goals; the magnitude of the 
•effects' ©f these programs on participating students, and the precision with 
which supplementary resources have been allocated by the use of indicators 
to tho s e s t uden tTwho were^in "mo st~ti e ed - o f-= as s i s t an ee . It ... wa s_no t e d th a t 
the first issue has been subjected to considerable research and debate - 
mostly without satisfactory resolution at this point of time. The second 
issue has received relatively less attention by researchers - but the . 
available findings in the United States and the United Kingdom have consist- 
ently suggested that the indicators used in the Title I and Educational 
Priority Areas programs have lacked precision in the delivery *of resources 
to those students who were in most need of assistance. 

In the absence of detailed research knowledge concerning the performance 
of indicators being used in Australia it was considered important to examine 
the implications of the second issue for Ehe conduct of the Disadvantaged 
Schools Program, At present there are nine different indicators being used 
for this one program* one at the "national level, and eight others being 
employed by various school systems. Not one of these indicators, has ever 
been subjected to a detailed examination with respect to either the specific \ 
definition of * disadvantaged 1 (Karmcl , 1975:92) which they purport to measuii, 
or the characteristics of the students which they identify as being educate - 
ionally disadvantaged, partner, there would appear to be no published 
research available which would enable an assessment to be made of the 
precision with which they may be used to identify students who are in most 
need of assistance, ■ 



The main aim of this study was to develop, validate, and describe the 
properties of a national indicator of educational disadvantage ?which was in 
harmony with the definition of ■ disadvantaged 1 provided for the conduct of 
the Disadvantaged Schools Program in Australia, 

Initially, a det^iWd review was prepared of the resource allocation 
responses which have been made in Australia to the changing concept of 
equality of educational opportunity . This was followed by the development 
of a theoretical model which was designed to quantify the optimal level of 
precision with which these responses could be used to allocate resources, 

By drawing upon the results of these two tasks a program of research 
was designed to prepare several inaTcators ~6"f "educational disadvantage wnicft 
would avoid the inadequacies of the currently available indicators , and 
would also provide a quantitative assessment of the capacity of these 
indicators to deliver resources to those students who were in most need of 
assistance. 

There were three main phases associated with the development of these 
indicators. First, a list of items describing important properties of 
indicators was" prepared aha" a" three -sta^e - strategy-was. devised . tQ develop __ _ 
the' indicators in a fashion which would optimize overall satisfaction among 
the demands of this list of properties, Second, the characteristics of the 
indicators were examined in a range of analyses which permitted the selection 
of an indicator with the best overall -performance . Thirds this 'preferred* 
indicator was eomparec with certain dimensions of residential different iatioii 
in order to enable a meaningful social description to be made of the _ construct 
assessed by thg indicator scores. 




CHAPTER 2 



RESOURCE ALLOCATION RESPONSES TO THE CHANGING 
CONCEPT OF EQUALITY 

Introduet ion 

Over the past two decades in Australia the concept, of equality of educat- 
ional opportunity has been subjected to a great deal of attention and review, 
The focus of this discussion has moved,; since the publication of the first 
report of the Australian Schools Commission (Karmel ,1973) , from what Dyer 
(1972) has described as a 'means' debate to an 'ends* debate, 

" The notion of equality of 'means 1 referred to the aim of establishing 
equality of educational resource provision across schools. -This type of 
equality has often been measured by comparing schools with respect to their 
physical plants, staffing quality* location, etc. The 'means 1 approach has 
variously been described as a concern for equal treatments (Husfe, 1S*72) or 
equal schools (Coleman, ISSeb) * + 

— , .^Itejmajtively, equality of 'ends' referred to equality in the end 
results of the educational process, "TTfii^has^d^only^been-asseMed^tr^... 
comparing students, or certain subgroups of students, on school achievement 
test scores, or on final educational attainments, The 'ends' interpretation, 
has also been referred to as a commitment to equal final goals (Husen, 1972) 
or equal students (Coleman, 1966b), 

In the following pages the changing nature of the concept of equality 
of educational opportunity in "Australia has been discussed* The framework 
for this discussion has been drawn from the lucid analysis presented by 
Huse*n (1972, 1975), Husin examined the changing nature of the concept by 
incorporating the 'means'/ 1 ends* distinction into developmental^ stages which 
corresponded to three distinct social philosophies: conservative* liberal* 
and redemptive. ~- - - •- - -_. 

Many other authors have employed a similar division of these develop- 
mental stages in their discussion of equality of educational opportunity. 
In Table 2.1 a list of authors and their terminology has been presented in 
% forffl which links the three-stage model proposed, by Husdh (1972^ 1975) to 
approaches presented by the other authors . Most of these authors have used 
different styles of argument, and while the overldp of'stages between authors 
was often targe it was never exact/ The examination of the concept of 



equality of educational opportunity by Crittenden (197Sa, 1978b) and Keeves 
(1978) provided an Australian perspective several years after the publication 
of the first report of the Schools Commission CKarmel , 1973); Halsey (1372); 
Husen (1972, 1975} , and Neave (1979) have described European developments; 
the other authors, Bell (1977), Coleman (1968) , Gordon (1972), Jencks et al 
(1972) , and Hosteller and Moynihan (1972) , have centred their discussion 
mostly on developments in the United States, 

Stages in the Development of the Concept of Equality 
o f Educational Opportunity in Australia 

1 Conservative 

From the time of early settlement to around the end of the nineteenth century, 
the provision of education in Australia was mostly limited to schooling 
administered by reCigious or private organizations* The educational system 
was designed to provide educational opportunities which were appropriate to 
one's station in life. The private secondary schools and universities mostly 
catered for students from professional families who were 'destined' 
for professional occupations. The tuition fees for these institutions were 
substantial and only a limited number of scholarships were made available in 
order to assist exceptional students whose efforts would bring credit to the 
institutions. 

By the *early years of this century each of the Australian States had 
established public education systems, covering the elementary years of 
schooling, which were* designed to be free, secular and compulsory. The 
elementary schools provided training in the.basic skills of reading, writing, 
and arithmetic for those who were to form the mass of manual, semi-skilled 
and clerical workers. Limited numbers of public secondary schools were also 
set up in each State, These schools were highly selective and in many cases 
were not free, ' .. . 

The general structure of Australian education at this time was therefore 

centred around a vertically separated system in which educational provision 

was fairly clearly divided along class lines, Husin (1972) has suggested 

jthatone of the more conservative assumptions behind this x type of approach 

had its origins in a religious view of the world! 

God had given each individual the aptitudes that corresponded 
to the caste or social class in which he was born... he had 
not only to make optimal use of his capacity but be content 
with it. (Husen, 1972:28) ■ 



Table 2,1 Tg rainology Used by Various Author^ h tliei^Discugsionif the Changing Nature of the 

" - - - - - - ----- ■ v - - - - i if 

Concept of bquality of Educational Ogportimty 



Equality of Educational Opportunity 



\ 



Stage 1 



Stag© 2 



Stage S 



Bell (19/7} 
Coleman (1963) 



Natural Aristocracy 



Liberal Ethic 



Socialist Ethic 



Differentiated Opportunity [Equality of] Inputs ' [Equality of] Results 



Crittenden (1978a, 1978b) 
Gordon (1972) 



Halsey (1972) 



Keeves (1978) 

Mosteiler and 
Moynihan (19/2 

Heave (1979} 



[The Dichotomy of the]" 
Edueiible/Uiieducable 



Husln (1972, 19/5] ; Conservative 
Jencks et al (1972) 



Conservative 



Predestinative 



liberal 



Egalitarian 



e Universality of [Equality of] Survival 
the] Educable Skills 



[Equality of] Access ' [Equality of] Achitvement 

Liberal Redemptive 

[Equality of] Opportunity [Equality of] Results 1 



Liberal 



Needs Baaed 



[Equality of] School . [Equality of] School 
Inputs Outputs ■ 



Redemptive 



Dissenting/Sectarian 
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Within this conservative framework Australian governments considered 
that th« purpose of education was to nurture 1 tL*lent^^?rfie concept of 
equality of educational opportunity for all students was consequently not 
roallv re If* /ant - Rather, policies were explicitly designed to produce what 
Coleman (1365) hss described as differentiated educational opportunity 1 , 

2 Libera - r 

A gradual movement from a conservative to a more liberal view of equality 
of educational opportunity took place in Australia during this century. 
This change was accelerated with £he massive growth in the secondary and 
tertiary education sectors after the Second World War. In public secondary 
schools fees were eliminated and distinctions -b etwee n curricula for students 
preparing for professions and those preparing for sub-pFofessional , commercial, 
and technical occupations had diminished. At both secondary and tertiarv level; 
there was a great expansion of scholarships for the more able students. 
Within each State attempts were made to ensure that there was a uniformity 
in standards of staffing and essential equipment for all schools. 

This emphasis on uniformity of educational provision appeared tc k be 
based on the assumption that individuals were born with certain * relatively 
constant, abilities or intelligence. Therefore the appropriate government 
response was to remove those external material obstacles which would prevent 
students making best use of their abilities*, Sen rag (1970) has described 
the liberal approach as 'social Darwinism 1 ?n which everyone in the 'jungle 1 
had the same facilities and therefore success was decided by the 1 student f s 
capacity for resourcefulness, ambit ion * ability and strength, The move from 
a conservative to a liberal view carried the hope that the rewards of educat- 
ional systems would pass from being based on socio-economic background and 
personal influence to, being dependent upon . both ability and industry. 

A growing uncertainty about .the validity of the expected outcomes from 
the liberal view began to be supported by a range of educational research 
studies which described the achievement and attainment levels of different 
social groups. By the latu 1960 's it had become common knowledge that 'the 
major det^fminant^ of educational attainment were not school -masters but 
social situationSs not curriculum but motivation, not formal access to the 
school but support in the family and the community f - .(Halsey , 1972:8). 

3 Redemptive ■ • 

The publication of the report of the Interim Committee of the Australian 
Schools Commission (Karmel, 1973) moved discussion in Australia from , a 

: .2,1 



liberal to a redemptive view of equality of educations! opportunity. This 
report was prepared at a time when a flood of research evidence was demon- 
strating that the liberal view had tailed. Achievement and attainment 
levels in Australia, even under conditions of comparable access, uniform 
curricula, and comparable material provision, still appeared to be firmly 
linked to the socioeconomic circumstances *of the student's home environment/ 

The main sources of oressure for a review of the liberal approach 
stemmed from the large-seal^ investigations which had been carried out in 
the United Kingdom (Plowden, 1267} and the United States [Coleman et al , --. 
1966a) a The results of* these reports provided the catalyst required to move 
the debate from a crncern with eqjuality of inputs, associated with access 
and material provision, to a concern with equality of outputs, associated 
with final student achievements and attainments, 

Neave (1979) noted that: i;he transition to a redemptive view was marked 

by the growth of the notion that the educational system should be able to 

adapt to the needs of individual students, - According to this interpretation 

'failure on the part of the individual is as much evidence of the inability 

> - % 

of the education system to adapt to the individual's need as it is -of the 

individual's inability to meet the exigencies of the education system 1 

(Neave, 1979:1663, - " 

Husin (19723 formulated the redemptive view of equality of educational 

opportunity in the following fashion: . < 

It is not enough to establish formal equality of access to 
■- education. Y^ 1 ^ has also to provide equality in the pre-school 
institutions or in the regular school for children of various 
social backgrounds to acquire intelligence, (Husinj 1972 t 38} 

Husin (1974} warned that a move to the redemptive view required a 
complete revision of basic pedagogical notions by the education system. The 
common element in, action taken by schools would be J individualization' of 
the entire system of instruction (Blockj 1971}. This type of learning 
environment would be a necessary step towards being able to 'provide equal 
opportunity for unequal treatment so far as socially relevant differences . 
are concerned' (Husfn, 1974:40),* 

The Australian Schools Commission's View of ^ 
Equality of Sducational Opportunity / . 

1 Equality: ffs a 'Principal Value' , w ■ 

In the second chapter of their report, under the heading of 'Values and, 
Perspectives' the Interim Committee for the Australian Schools Commission 



lisred the 'principal values wfrom which its recommendations have been 
derived 1 [Kanae!-, 1973:10). The two values listed und^r the 'Equality 1 sub^ 
heading -were coupled with' some general descriptions of the actions required 
to reinforce these values, These actions dealt with aspects of resource 
allocation ^hich have^come to be known as forms of -'positive discrimination \ 
in which 8 the" schools must supply a compensating environment* CFlowden, 
ayfi7,:573 . * " ' ■ - 

The first value was- concerned with 'the principle that the standard 
of schooling a child receives should not depend on what his parents are able 
or filling to contribute directly to it, or whether he is enrolled in a 
government or non= government institution* (Karmel, 1973:113 . This principle 
supported a liberal ^view of equality of educational opportunity. That is* 
it affirmed students 1 rights to have equal access to schools of equal 
standards. However the action with respect to this value which was- 
reeommended included the notion of compensation through schooling vor unequa 
environmental conditions and therefore seemed fb be taking a more redemptive 
view of equality of educational opportunity: ^ 

J^The Committee believes that] there are .good reasons for ' . _ 
attempting to compensate to some extent through schooling forv^ 
unequal out -of -school^ situations in order to ensure that^the 
child's overall condition of upbringing is as free of ' » 
restriction tdue to the circumstances of his family as public 
,n action through the schools can make it, (Karmel, 1973:11) 

The second value was associated with 'the right of every child, within 

practicable limits, to be prepared through schooling for full participation 

'in society, both for his own and for society's benefit 1 (Karmel^ jS?3:11) . 

This value moved beyond^the outcomes of schooling to a form of equal 

opportunity in the life of adult society. It was a somewhat tangled mixture 

of, liberal and redemptive views because 5 the concept of. 'full participation 

in society* could mean either participation up to a level governed by 

individual ability * or equal? level of participation, or both of these at the 

same time, , However the action required to reinforce this value again took 

a e redemptive view by suggesting 'compensatory action through making 'special 

efforts 1 for a sub-group of students: 

[The Committee] accepts the obligation to make special efforts 
\, to assist those whose pace of learning is 'slow, .= 

(Karmel,_ 1973:11] 

4 In the final paragraph dealing with 'Equality* , a clearly redemptive 
view of equality of educational opportunity was emphasized through proposals 
concerning the allocation of funds? required to support aspects of equality 
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inherent in the two values described above. The report contained proposals 
that there should he 'greater than average public spending on education for 
children handicapped in various ways 1 and that there should be 'some 
altering of the balance of expenditure in favour -of earlier stages of 
education to consolidate a more equal basic achievement between children 1 
(Karmel , 1973:11). These two proposals formed the essential elements of 
a resource allocation program based on the redemptive view: greater 
resources were to be given to those students with handicaps which inhibited -— - 
their learningj in order to obtain a degree of equalization in final achieve- 
ment levels for certain valued areas of the educa^'^n process, 

2 Equality; As a 'Limited Goal 1 

The Interim Committee report (Karmel , 1973) and a subsequent report (McKinnon, 
1976) of the Schools Commission presented strong opposition to the pursuit of 
equal educational outcomes, whether the units being considered were 
individuals or'groups. 

The Interim Committee report , as part of a discussion of equality of 

outcomes for groups * presented the following quotation from Halsey (1972) : 

. . . •* the goal should not be the liberal one of equality of access 
but equality of outcome for the median member of each identifi- 
able non-edueationaliy defined group , i , e the average woman or 
negro or proletarian or rural dweller should have the same level 
of educational attainment as the average male s white, white- 
. " . collar suburbanite, (Karmel s 1973:72) 

This view was rejected as unsatisfactory because the Interim Committee 
considered that it would not necessarily result in a more equal society, it 
might become "excessively expensive, it could lead to retardation of the , 
most able students in order to reduce the range of achievement, and it 
could lead to concentration on academic performance as the only criterion 
Of excellence (Karmel, 1973:22-23) . 

* The 1976 report of the Schools Commission was somewhat less generous 

in providing reasons for its rejection" of the idea of equality of outcomes * 

for individuals. The idea was dismissed^ with limited discussion* in one 

sentence: *' " 

Thi Commission has never spoken'/ nor does it now, in favour of 
promoting eq%al educational outcomes among individuals, 

(McKinnon j 1976:10) 

In place of a policy o'f equal outcomes the Interim Committee report 
accepted a more 'limited 1 goal: , 



The Committee believes that schools should attempt to provide a 
more equaL opportunity for all children to participate more 
fullv in the society as valued and respected members of it, 

(Karmel\ 1973:23) 

A close examination of this 1 limited' goal revealed three main themes which 
have recurred throughout the Schools Commission Reports. The wording of the 
Interim Committee's definition has been broken into three pieces in the 
following paragraphs in order to highlight these themes : 



(a) . . schools should attempt to provide , ,» 

The report of the Interim Committee of the Australian Schools Commission 
was prepared at a time when several major reports (Coleman et al } 1966; 
Jencks et al , 1972} had emerged with a message that the contribution which 
schools made to explaining variation in school achievement or educational 
attainment was small after the contribution made by the home environments 
of students was taken into account . The findings of these studies were 
similar to findings obtained in Australia from two large-scale evaluation 
studies in the areas of Mathematics [Keeves, 1968) and Science (Rosier, 1973) 

Also, at that time, several reports which reviewed the effectiveness 
of compensatory education programs [Little and Smith, 1971) and the effect- 
iveness of various educational resources (Averch et al , 1971) were published. 
These reviews provided little encouragement for the previously popular idea 
that manipulation of learning environments through increased expenditure 
on education would great ly^af feet student achievement, ^> 

The discussion of 'Equality 1 in the Interim Committee's report acknow- 
ledged these findings by incorporating cautionary statements concerning the 
expected magnitude of 1 school effects* in, the pursuit of equality, 
- ■ Attempts to make the school more effective in its contribution - 

to developed ability are favoured by the Committee iu full 
awareness of the limitations of their potential power, 

(Karmel, 1973:22) ■ 

It is almost certainly the case that schools alone cannot effect 
the degree of environmental change necessary to enable, all groups 
of children to reach, an equal average level of educational 
attainment," £Karmel f 1973:22) . 

Similar expressions of caution were given in a later Schools Commission 
report during a discussion of the influence of education on social stratifi- 
cation in society: 

Schools do not have the power to make society more equal, 

(McKiimon , 1976:7) 



The power of education to change the relative position of 
social groups has proved small in all advanced societies, 

(McKinnon, 1976:7) 

The views expressed in the above quotations had important implications 
for the interpretation of the Schools Commission^ 1 limited 1 goal with 
respect to outcomes . Rather than expecting schools to contribute to 
equality they were asked to \it tempt to provide 1 a contribution. This 
hesitance in emphasis turned the 'limited 1 goal into something which 
resembled a hope for instead of an expectation of equal educational outcomes. 

(b) , a more equal opportunity for all children , 

— — j 

In a previous section a description of the Schools Commission's 
rejection of a strict interpretation of equality of outcomes , was presented. 
This rejection applied to both the goal of equal average outcomes for social 
groups and the" goal of equal outcomes for individuals. 

By referring to 'all children 1 in the 1 limited 1 goal, the Schools ... 
Commission concentrated on the outcomes for individuals rather than social 
groups. However, in place of a strict interpretation of equal outcomes, 
the Schools Commission supported a somewhat = toned-down interpretation. 
Instead of 1 equal r opportunity, the * limited r goal called for f more equal 1 
opportunity. 

Statements in suppoitjof a need for 'more equal 1 opportunity have 
appeared in a number of forms in the reports ^prepared for the Schools 
Commission i 

The Interim Committee's report called for 'more equal basic achieve- 
ment 1 , 'more equal opportunities to partake in higher education 1 , 'more 
"equal outcomes from schooling 1 ; 'more- equal performance 1 , 'more equal - " 
opportunity* and 'more equal chances for educational success 1 (Karmel, 
1973:11, 20, 22, 23, 93, §4). -. ' • " 

Similarly, the first and second reports of the Schools Commission 
supported policies which emphasised 'more equal outcomes 1 (McKinnon, 1975:6) 
and 'more serious contributions to equalizing the opportunities of children 1 
(McKinnon, 1976:11) . • 

These cautious approaches to the concept of equality of educational 
opportunity were in close harmony with the use of the word 'limited 1 that 
had been employe^ to describe the Interim Committee '3 goal of equal 
educational* outcomes. 



( c ) ,. a to participate more fully in the society as valued and 

respected members of it . 
The final section of the Schools Commission's definition of the 
■ limited 1 goal of equal educational outcomes described the outcomes which 
the schools were expected to 'attempt* to make 'more' equal 1 among students. 
This section provided little useful information about the specific activ- 
ities or structures with which the schools might be concerned in order to 
achieve the 'limited' goal; . , * " 

■ Some clues were given about the specific roles of the schools in the 
sentences which followed the definition. The schools were expected to 
provide! - - * - 

(i) 'Basic skills* necessary to 'participate In the society' , and to 
're-enter formal education at a later stage', 
[ii) 'A comprehensive core curriculum'. 

(i ii) " ' An"int reduction to- u-variety- o f- leisure pursuits ' . — — - 

... ■ . • _j (Karmel,_19 73:23) 

. The second and third of these roles referred to the provision of 
/certain. curriculum content. The appropriate response by the schools would: 
have been to ensure that students had access to these activities. No 
attempt was made to suggest that students were to reach particular levels 
of performance. In this sense, these two roles could be linked to a 
liberal view of equality of ^educational opportunity because the essential 
requirement was that .schools should guarantee exposure to, rather than 
mastery, of, the curriculum content, .= 

jln contrast the first role emphasised a redemptive view of equality 
because it implied that all students would be required to achieve competence 
in thWe 'basic skills* which were. necessary to participate in society or 
to re!-enter formal education at a later stage, * - ^ 

The responsibility of the schools for the development of 'basic skills* 
continued to be emphasised and presented in more detail in the first and 
second reports of the Schools Commission. These basic skills tended to 
fall into two broad categories!, basic cognitive skills and basic personality 
and social skills. 

The basic cognitive skills were described in a variety of ways : 'the 
basic threshold of schooling 1 » 'certain threshold levels of education', 
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'reading the moHt basic tool*, 'the basic plateau of competence in 

schooling' (McKinnon, 1975:6, 7, 8), =l WsTc learning skills* , 'levels of 
competence', 'basic credentials', 'to read, use language and to figure 
to a level which secondary school ing assumes ' , 'access skills', 'reading 
and language competence' (McKinnon, 1976:8, 9, 10), 

The basic personality and social skills were described in a somewhat 
more a b s t r a c t f a s h i o n7^~Th e^~ St u d e nts~ were'Te qtmre d -- to ~ l= fi a 1 d^an =i d en t "rty t ~ i ^* = 
as social beings', 'become full citizens', develop 'the capacity and 
confidence to forge meaningful links with others' , 'organize and take 
personal responsibility', 'shape the character of their own lives and 
participate in shaping the character of the society' (McKinnon, 1975:73, 
'acquire a capacity for making choices through an understanding of the 
society 1 , 'reflect on experience'* 'act individually or in association 
with others to change arrangements they find unjust or humanely degrading' 
(McKinnon, 1976:9, 12). 



A striking difference between the two types of basic skills was 
associated with the time scale upon which successful mastery might be judged, 
The basic cognitive skills were concerned with the need for mastery of the 
fundamental skills of literacy and numeracy, The^e skills could be assessed 
with criterion-referenced testing during or after the process of schooling. 
On the other hand, the basic personality and social skilK referred to 
individual characteristics which would not^be able to be assessed until \ 
later adult life, ^ ' 

.' <; i \. 

^ Summary v 

The collation of quotations presented above would appear, to indicate that 
the Schools Commission's perception of equality might be appropriately 
characterized as a 'limited liberalTredamptive hope ' ^ 

The word 'hope' emerged as a suitable summary of the Schools 
Commission's response to those research findings which had demonstrated 
that schools had relatively small effects In explaining variation in student 
achievement and attainment, This hope was expressed by asking the schools 
to 'attempt' to be more effective in 1 full awareness of the limitations of 
their potential power' (Karmel , 1973*22), 

V 

The notion of 'limited' referred to a less- than- full commitment to 
equality of outcomes, ,^he Schools Commission rejected a strict interpret- 
ation of equal outcomes for either groups qt individuals. Instead a tent- 
ative version of 'more equal', rather than 'equal', outcomes was supported, ^ 



This limited approach, incorporated in an explicit definition of equality 
presented in the first Schools Commission report, expressed the need to 
aim for 'mere equal 1 outcomes from schooling and to 'mitigate* social group 
disparities (McKinnon, 1975:6)* 

The 'liberal-redemptive' nature of the Schools Commission's 'limited 
hope 1 was expressed in the expected roles of the schools as agents for 
-"obtaining equality of educational opportunity, These roles combined liberal 
calls for uniformity^o.£jnaterial provision: 'a comprehensive core curric- 
ulum' and 'an introduction to a wide variety of leisure pursuits' with 
redemptive views concerning the need for all students to master the basic 
skills necessary to 'participate in the society 1 and to 're-enter formal 
education at a later stage' (Karmel, 1973:23) . 

This liberal-redemptive mixture also surfaced in the Schools 
Commission's rationaie-fo^resource allocation, The liberal value that the 
standard of schooling received by a student 'should not depend on what his 
parents are able or willing to contribute directly to it, or whether he is 
enrolled in a government or non-government institution 1 , was to be 
established by the redemptive response of taking public action-' to 
compensate for unequal out -of -school situations 1 in order to ensure that a 
child's development was 'free of restriction due to the circumstances of 
his family' (Karmel, 1973:11) . 

- The Australian Schools Commission's Resource Allocation S trategy . 
The Australian Schools Commission pursued its 'limited liberal -redemptive 
hope' via a major review of the federal funding of Australian education. 
The focus of the range of funding programs which erierged from this review 
were. described_.as falling along two main J dimensions ' . These dimensions, 
which were labelled 'inputs of resources to schools and school systems' 
and 'degree of disadvantage" of groups of pupils in particular schools 1 
(Karmel, 1973:50), have closely paralleled resource allocation responses 
which would be respectively appropriate to the liberal and redemptive views 
of equality of- educational opportunity. 

The first dimension involved a strictly liberal interpretation of the 
'needs' of Australian schools and students. This dimension concentrated 
on inputs of material resources which, for example, were required to upgrad 
school buildings, expand library facilities, and improve the provision of 
teachers and buildings for special education, The largest single program 
in this area was concerned with, equalizing recurrent expenditures across 



all Australian schools, A school's need far supplementary recurrent 
resources to cove r the i^sneral 'running costs' of education was assessed • 
by comparing the school '^s per pupil expenditure, with the national average 
for government schools* The essential goal for the programs prepared for 
this dimension was to tgow&^e towards uniformity of material resource 
provision* at an aceeptaez^l* standard* across all schools in Australia* 

No attempt was mage in the initial planning of these programs to link 
expenditure with educatic^anai outcomes". It was conceded by the Schools 
Commission that 'there is^s no simple mians-end relationship in education 
between resources employe^ad and conseqc'ential outcomes* neither is there 
an opt i mum combination oBP resources which will achieve' a desired objective 
in any circumstance 1 C^ar^rrnel, 1973 rSQ) . 

.The second dimenstors^ was redemptive in nature because it acknowledged 
that 'there are schools Aust,„ alia which require greater thin average 

resources if they ar.e to be effective with the children they serve ' CKarmel, 
1973:91), This dimensio^a led to the development of positive discrimination 
in favour of 'disadvanta Ega ed schools', Tl^/primary aim of the resulting 
funding program was eon c^srned with facilitating variation in school programs 
in ways which would en^hLSe disadvantaged children to learn store successfully. 
Unlike the programs basecH. on the first dimension, ^he Disadvantaged Schools . 
Program was expected t§ tcaave specific educational outcomes. The emphasis 
was to he placed on 'r^dizacing differences in the educational performance 
of socially disadvahtagecB, children and the rest of the school population ' 
over the _ tradition a.l^J^jnuat: of s chop 1 ing,' (Karmel , 1973:93) , 

The identification schools and students to receive assistance under, 

the programs developed foor the first dimension was based on simple account- 
ancy procedures which ,£fii&Kjit@d expenditures per pupil, accomniodotion space s 
library resources, etc I That is, the information 4 required for this di mensio n 
consisted of quantifiable^ material resources which could be directly and 
accurate ly t flieasured* , 

However the identifiS^ication of schools and students for tjte second 
dimension required the coasaristruction of an indicator which would form an 
appropriate measure of thus.© construct of 'disadvantage'. That is, since the 
construct of disadvantages was not a physical entity which could be directly - 
and accurately measureci i there^ was a need for the development of an indicator 
which would provide a §ui_iable surrogate for the construct. 



The Disadvantaged Schools Fr-ogrsiffl was int r o<iucz^ed to implement the reeo — mmend- 
ations presented in the Report ofir the Interim Committee for the Austya^&lian 
Schools Commission (Karrnel, 1 9 73)3 . This progr^mni was a landmark for feeders! 
intervention in Australian odu c atn ion Decade* i_ x represented the first large- 
scale attempt to foster a rodemptn ive view Of equality of educational 
opportunity ~ " The - redciiipt ivo- spii^^i t=of- t pTO-^jram- was=-cap t ured'-by-a--s=M:n^l^ — 
sentence in an early section of t=he, Karm^i ^epg^oru 

More equal outcomes ft^^m schooling r—equire unequal treatment =z, 

of children, tKarmel, 1973^2) 

The 'unequal treatment 1 ref^sxred to th^ p^xovision of greater tha^Mi 
average resources* to disadvantagged schools ; a_jid the 'more equal outcox^?ines 1 
referred to an f emphasis on reduesing differ^fittes in the educational pe-'^xform- 
ance of socially disadvantaged chat il dm* and th^a rest of the school pop^oulation 
(Kannei, 1973:91 , 93) , 

In acknowledgement of an ear^lier admissio^Ti that there was uncerta._s.inty 
about the resource inputs - educational OutpUt^s nexus, the Karmel Repo «_rt 
presented several liberal justifications as additional support for the-_== 
resource allocation measures inte'oduc^d as p£r— % of the Disadvantaged S^chools 
Program, The supplementary assisstanci to Disadvantaged Schools was exz^rpeeted 
to ensure greater equality in te ^iu s of regQurc^e inputs for all schools • 

because: = - ---- — - " ■ ' 

T" ~\~ ~ — Dis advantaged schools v-*^ere usually a^_mong the worst provided for 
in terms] of buildings, playing spraco, and otJie__r_r facilities, 

. 2i ! Students in Disadvantaged gchoo is ai&Joyed less overall publi-^c 
support for their education becaase they typiteslly did not continue to the 
publicly-subsidised higher leV^iw of School i^g^ and tertiary education, ^ and 

1 3 Students in Disadvantaged schools xm were exposed to suyr^ound- 
ings and a school community and program whiQji prevented their school in 
from being 'enjoyable and fruit F u-1 in itself" 1 * 

Choice of Ind_igax_or 

The Australian Schools Commission examined two^- alternative approaches "* %o trj^ 
tho establishment of a priority IE. ist of disadvantaged schools i sub jeer— t ive 
assessment based on information oBtaine^ofrofn informed persons within the 
school systems, and objective assessment which- required the construct! on 
of suitable objective indicators for Schools* 



The s^xibject ive assessment approach was rejected because there would 
have been a lack of inter-system comparability in the information obtained 
from each school system* Instead, a limited amount of subjective Inform- 
ation was used as validation data for the objective, procedures which were 
adopted CK^amel, 1?73:166) . 

The ui.se of objective assessments required that decisis ons be made as 
to whether^ the appropriate indicators would be Concerned w^ith educational 
achieVemeT&t or social criteria, Blackburn (1979b) has presented several 
reason s^wt&y social criteria were favoured for the identif y c a tion of _&is - 



advantagecH. schools, These reasons may be divided into tht-ee main areas, 

First, there was a concern that indicators based on s_ enlevement 
measures concentrated too narrowly on one aspect of educat ional disadvantage 
iiB educational achievement criteria bypass the broader aspects 
of support and development with which we might expect the 
schools to be concerned- (Blackburn, 107011) "'- 

Secoi^d, there wr.r. a fear that the use of achievement measures might . 
have inf licenced the curricula of disadvantaged schools in >?ays which would 
have preve^nted attempts to adapt to, the specific needs of - the students. - 
That is, excessive attention given to test score's my hav& caused the school 
to resort to the 'intensive application of methods which b^ave been unsuccess- 
ful in the» past 1 (Blackburn, 1979b:2) . " 

The t=hird reason described the need to avoid certain 'educational. 
dangers 1 ^ making achievement measures central to the selection of dis- 
advantaged schools i the appearance of rewarding incompetence, and the 
diversion of attention from the 1 fundamental school changes * which was 
considerec^ to be an important feature of the program 

The asocial criteria upon which the indicators of disadvantage ware 
based were concerned with the characteristics the neighbourhoods which 
^surrounde^cS^schoois i - . 1 — — — - .- 



The Committee has chosen the term ! disadvptBgecm * in relation 
to schools drawing a high proportion^ of* enrolments from neigh- 
bourhoods having certain characteristics Known tee be generally 
associated with a low capacity to take advantage of educational 
facilities, (Karmel, 1973:92) 

Cen^i=s data were used for the construction of the indicators rather 
than data obtained from the families having children attending the schools. 
These datssa were preferred because they were 'likely to be more accurate ! # 
and because, they avoided the 'invasion of privacy involved in seeking out 
information which can be associated with particular tallies by ,the people 



using the data*, A further consideration was that the characteristics of 
the population surrounding the school were believed to be 'part of the 
total environment of the child* (Blackburn, 1979b ;4) , 

Units of Identification and Funding 

-s — ■ — *— " 

The Austro lan Schools Commission decided to use schools,* rather than 
individual students, as the unit of identification and funding. That is, 
the indicators of disadvantage were used to rank schools in order of 'dis- 
advantage 1 and then all students who were members of schools below a 
specified cut -off point on the distribution of schools were eligible to 
participate in the Disadvantaged Schools Program. 

In the early stages of the program an Australia- wide list of schools 
was prepared by the Australian Schools Commission as a guide to assist 
detailed examination of these schools by school system authorities. More 
recently each school system has taken greater control of preparing its own 
list of disadvantaged schools. Within each of the school systems, the 
school has remained the basic unit of identification and funding. 

The Disadvantaged Scho ols Pro g r am! Indicator* at the National Level 
The 1%?5 Indicator ' 

The first lists of disadvantaged schools were developed at a national level 
by the interim Committee of the Australian Schools Commission. The. lists 
were presented to school systems throughout Australia for considerapion during 
1973 and were adopted for funding purposes after any major anomalies had been 
corrected. 

v ; %- The development of these lists employed a measure called the •Socio- 
economic Scale', which was derived from -information obtained for .the 1971 
Census. The main components used in the scale were: socioeconomic status,, 
ethnicity, extent of schooling, unemployment, residential mobility, certain- 
aspects of the family, religion* adherence, number of Aborigines and housing 
conditions.- Details describing the 38 censor, derived variables were briefly 
summarized in Appendix E. of the Interim Committee's report (Karmel, 1973:167). 

' The ■■Socioeconomic Scale" was produced ly using principal components 
analysis followed by factor rotation .and then deletion of 'variables which 
' did not assist in discriminating among^dlstricts' (Karmel, 1973s 166). The 
weights obtained from these analyses werexthen applied to the component 
variables to obtain each school's measure on. the Socioeconomic Scale. 



Tht* interim Committee decided that 'bonssuse of the markedly different 
- social compos iti on of mijor urban areas a^ co*Qmpared with non -major urban 
areas', a separate* analysis would be condugtectH for each type of area (Karmel* 
1973" 165}, The principal/component analysis technique was applied to the 
correlation matrices Which were developed, sgpoarately for major urban and 
non-major urban ar^a^ "The principal compone^snt extracted for the major urban 
areas contained IB v^ti^'os* and the princip^aal component extracted ^for the 
non-major urban ar^a^ contained 12 variables [Australia* Schools Commission* 
liSOa) , The variables and their raw componeJVxat weights from the principal 
^"c^m^neritTnalWel ^aVckm reported in Appe-:^ndix A, 

The graphically defined ^upll catchment . area of each school was' converted 
to a numeric code refrtenting the Census Coi Elector's- Districts linked to each 
school* These c^d^s Were used to obtain avervwage scores for each school on 
the census vari0bie5 in the analyses des*scribed above* The weights 
obtained .from the principal component analyse :^s were then combined with these 
average scores to obtain Ichool scores on the * 'Socioeconomic Scale'. 

The schools, wer^ wanted in order of thei^r scores, on the * Socioeconomic 
Scale* and, beginninf fron the most disadyant %=aged schoolSs enrolments were 
counted until 15 per tent of enrolments i n ma ^ «l j o r" urbarT s choo 1 s and 10 per 
cent of enrolments if* tiomnajor urban schools — were reached. The schools 
on the lists below thfesecut-off points toTme^^d the first list of Disadvant- 
aged Schools. . 

It was important to note that the princi^frpal component analyses and 
subsequent component delations were carried o**ut by using Collector's 
Districts as the unit§ of analysis and not s£iPhools, Therefore, the properties 
of these techniques whicii the Schools Commissi -ion considered to be important s 
'to ascertain which variables were the most es-fficient discriminators' s to 
provide 'appropriate Welding for the va^iabi^ies which were ultimately 
r^tained^, to present 'an objective basis iot - actually determining the extent 
to which a 1 imite^ ny^b&r of factors are "lateBDi t in-a "given set of measure- 
ments '* and to caieui^wn'o factor whieji wag 'interpreted as relating to _ 
socioeconomic Class 1 - (KPjiolj 1973:165* 166), were all properties which; 
applied only to CoJ lector's Districts,' The f^saet that the schools, were scored 
on the outcomes of th^soanalyses according t£3o their a catchment area charact- 
eristics in no way guftxitoed that the prop^r^rties listed above were trans-* 
ferrable to statenient^ otait populations ? 'of sc^chools. 
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One can only speculate about the logic of the Schools Commission's 
methodology in deriving the component scores* Since each school was ident- 
ified in terms of the Collectors Districts associated with its catchment 
area it would seem to have required no greater degree of computational 
effort or resources to conduct the analyses by using the school as the 
unit of analysis. It is quite feasible that a totally different set of 
components would have emerged if schools had been used as the unit of 
analysis. This may then have resulted in a different rearrangement of the 
Socioeconomic Scale scores for schools. 



The 1980 Indicator 

In 1979 the Schools Commission decided to revise the 1973 'Socioeconomic 
Scale* by conducting- a new set of analyses with the 1976 Census data. Due 
to time and resource constraints it was not possible to either update or 
repeat the school catchment mapping exercise which had taken place during 
1973, Also, while the 1976 Census did eontain information which would have 
permitted a link to be made between each school and its community, the 
Australian Bureau of Statistics considered that disclosure of data at the 
school aggregation level could lead to problems of confidentiality. These 
diliimiitles^pfevented the .--prep.aTat^njDf_ index scores associated with 
particular schools and consequently the Schools Commissi on- was- unable to ^ 
prepare a revised priority list of schools for the Disadvantaged Schools 
Program, The 1980 Indicator provided scores only for Census Collector's 
Districts and was therefore restricted in its use to .assisting with decision 
concerning the division of funds between school syr terns. The nomination of 
particular schools for participation in the Disadvantaged Schools Program 
has subsequently become completely dependent on indicators developed within 
each school system. , i 

The indicator developed in 1980, known as the 'Socioeconomic Index 1 
was designed *t_o determine the relative number of school children living in 
areas of concentrated disadvantage in each State 1 , (Linacre et al , 1980:4) . 
The * areas* referred to the Collector's Districts used during the 1976 
Population Census. A final list of 32 census-derived variables was selected 
for the construction of the indicator after consultation with the author .of 
'this report', These variables were selected because preliminary analyses 
conducted by the author showed that many of these variables were highly , 
correlated with school mean scores on tests of educational achievement. 
The variables selected for the construction of the indicator covered similar 



tepjcs to those used in the 1973 index: occupation, education, inc^^ , 
family structure, dwellings, and ethnicity, Details of the con struct icn 
and selection of these variables Jiave been described by Linacre £t^gl^_ 
(1980:55-58) . ^ 

The principal components analysis technique used for the 1073 4n4er 
was again used for the 1980 analyses. However, following an investigation 
of analyses carried out separately for major urban, other urban s rural 
locality and rural balance areas* it was demonstrated that a single ARstfiiis 
overall principle component analysis would provide appropriate indicator 
scores for each of the four regional classification^ "tLinaere, et^ai;, 2080: 
9-10)* The weights derived from the Australia-overall principal components 
analysis were applied to the %2 variables to obtain a score for each 
CollectorV- District on the Socioeconomic index 1 . The variables atid -thiir 
standardized component weights from the principal component analysis havg 
been reported in. Appendix A, . ~~ — 7 " 

In order to carry out the distribution of funds between school Bym\®$, 
the 'Socioeconomic Index 1 scores were transformed in a fashion which a^psd 
that (1) the funds required to overcome disadvantage increased mono^anicsll^ 
with scores- on the transformed = index, and £2) the marg inal : -Increase ,o^: Jyiids . 
required to cope with disadvantage was diminished as scores on thm tr%ii* 
formed index increased. These transformed scores were used to cT^s%e 
'weighted enrolment 1 figures which were used to make decisions concerning 
the division of funds between school systems* Details of the calculations 
required to prepare the transformed indicator scores, and the use of 
.'weighted enrolment 1 figures have been presented by Linacre et ai (19^0). 

Following the. preparation of the 1980 ^ociOFCohomic Index 1 , the tali 
of developing methods for the selection of lists of * disadvantaged ^chadi 1 
became, by default, the responsibility of the school systems, 

i • 

The Disadvantaged Schools Programs Indicators at the School 

Syst^n Level « 

In .the years following the publication of the Report of the Interim COailttee 
for the Australian Schools Commission (Karmel, 1973) the school ^sys^effWirt 
each- Australian State/Territory began to take an interest in the deVslopsent 
of their own lists of 'disadvantaged schools 1 . initially this inte^e^Kis. 
associated .with minor anomalies which had "appeared on the first list: @£ 
disa4vanta^ed schools prepared by the Schools Commission. Interest l^cef 
turned to necessity whe)i the Schools Commission, through lack o£ i*e%oWrcss 



and information, was unable -cither to revise or refine its methods for the 
identification of disadvantaged schools. The following discussion of the . 
responses of/the Australian school systems to* this situation has been drawn 
from a collection of papers and seminar presentations prepared during 1979- 
80 for the Australian Schools* Commission Working Party on Disadvantaged ■ 
Schools (de Silva, 1980; New South Wales Department of Education, 1980; 
Ross* 1979a, 1980; South Australia Education Department, 1979; Tasmania 
Education Department , 1979; Western Australia Education^Department t 1979), 

the term "noh -government" has been used in this chapter - to refer to 

with, technical reports on indicator construction prepared by the Australian 
School k Commission. (See, for example, Australian Schools Commission (1980))* 

Wheteas all government school systems have developed their own 
indicators of educational disadvantage, only in the. Victorian and South 
Australian non a r government school systemsjiave indicators been prepared, In * 
other non-government school systems a wide range of variables were 
considered but no attempt has been made to combine these into indicators , 
The Queensland non-government system does not gather data on any variables. 

The variables used for the construction of indicators by Australian 
school systems have been described in detail in Appendix A , A summary, of 
the typns of variables used by the school systems has been presented in 
Table 2.2. It is important to remember that only the types of variables 
have been described and therefore this table does not distin- Ish between 
either the different metrics which were used to measure these variables or 
the^variable receding techniques which were unique to each school system. 

The 'most popular 1 variables across the systems were 'Occupational 
Status ©f Father/Breadwinner 1 and 'Mi gran ey 1 . These variables were used 
by six school systems. The occupational status variables were all based 

on the scaling procedu res developed at the Aus tralian National University 

( Broom ct al , 1965, 1977) , The variable describing the degree of migraney ^ 
was generally based. on the percentage of students from non-English speaking 
homes 1 No attempt appeared to have been made to distinguish between 
different subsets of languages. The next 'most popular 1 variables were 
•Aboriginal Students', 'Single Parents' and 'Student Turnover' , each being 
used by three school systems. These three variables were each measured in 
consistent fashion across the school systems. 
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The 'Isolation 1 variable was used by the Victorian and Queensland 
government school systems. In the Victorian government school system the 
degree of 'Isolation* was based on the distance in kilometres between the 
school an^I the next stage of education to which most students move. The 
Queensland government system assessment of isolation reflected a more 
detailed investigation of the concept of isolation. The measurement of 
the 'Isolation 1 variable was based on a 32-item scale developed by the 
Queensland Education Department, This scale focused on three main facets ! 
of the concept of isolation: cultural (with items concerning proximity 
of educational facilities, theatres, etc.), social (with items concerning 
~ proximity to health facilities, students usinjPSsoarding facilities, etc) 
and geographical [with items concerning the distance in kilometres from 
a range of major cities) . 

The 'Social Welfare' variable was used by the Western Australian and 
Tasmanian government school systems. The measure used in Western Australia 
was based on Department of Social Security records , whereas in Tasmania 
this information wa& obtained from the census data gathered by the 
Australian Bureau of * Statistics * 

The 'Income Measures- variable was ilso employed, by two school systems. 
The Tasmanian government system measure'/* this variable by using income 
levels obtained during the census* In New Soutn Wales a detailed 

examination of the occupational structure of family breadwinners was used 
in conjunction with estimates of mean income levels for certain occupational 
classifications to obtain an estimate of average family income per child 
for each school * * 

% Several variables were used only by individual school systems * ' Family ? 

Size-!, 'Achievement/ IQ 'Tests' , and 'Other Variables Based 0n ; Estimates 
Provided by Education Department Staff » / 

Each of the school systems avoided the issue of indicator validation 
and the development of measurable external validation criteria. The 
. inclusion of many variables was generally supported witn appeals to face 
validity by suggesting that these variables were linked to concepts such as 
= socioecdnolnic~~elass , student needs, and student achievements Other variables 
have been included following consultation with specialist committees and 
various specialist school system staff members. J 

The lack of widely accepted rules for the inclusion of variables was 
evidenced by the lack of uniformity with respect/ to the selection of types 
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of variables and the numbers of variables which were used in the indicators. 
Consequently, an examination of the information in Table 2.2 revealed a 
range of anomalies which was difficult to reconcile with a school funding 
program which was supposedly aimed at a particular subgroup of Australian 
schools and students; 

1 There was no single variable which was employed by all systems. 

2 One State developed separate indicators for Primary and Secondary 
schools while the other systems prepared one indicator for all schools, 

3 The numbers, of variables used in the development of indicators varied 
between systems from a minimum of one to a maximum of six, rf 

4 Whereas some systems used similar variables, the measurement of. these 
variables was sometimes undertaken in different ways. These differ- 
ences were centred around explicit differences in operational defin- 
itions* the application of a variety of receding rules * or the use of 
different types of data to measure the same variables. 

5 Achievement/ IQ tests were incorporated into the indicators for one 
■ system* In the other systems these variables were not included in 

their indicators however s ~th^ wab : 

often justified by reference to the high degree of interrelationships 
between these variables and the educational achievement of students. 

The weighting schemes used to combine the variables into indicators 
have been described in Appendix A, In each school system the signs of the 
weights were adjusted so that a high score on the indicators referred to a 
high level of educational disadvantage, 

No information was available from the school systems concerning the. 
rationale employed in establishing the weights. However, from simple 
observation of the magnitudes of the variable weights for the government -- 
systems, it could be seen that only integer weights were used . This 
suggested that the weights were probably assigned on the basis of 'expert , „ 
opinion 1 rather than by the application of quantitative statistical 
techniques. The South Australian hon -government system was the only system' to 
use non-integer weights. However, as for the other systems, no explanation 
was available to describe how th e b e we re self cted* 

The sources t of the data which were used to measure each variable 
employed in the development of the indicators have been described in 
Appendix A, I iu Table 2,3 these sources have been summarized for each school 
system, .^-^ . . ■ 
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Table 2,2 The Variables Used by Australian School Systems During _19SQ 

for the Preparation of Indicators of Educational Disadvantage 



Variables Government Non -Government^ 



NSW Vic Qld SA WA Tas a Vie SA 



Occupational Status 

of Father/Breadwinner * * * *(P) 

Mi gran cy * * * * 

Aboriginal Students * *- * 

Isolation * * 

Social Welfare * *(5) - 

Single Parents * 

Family Size *(3) 

Free Book Recipients „ * 

Income Measures * *(53 

Student Turnover * 

Working Parents 

Achievement/IQ Tests *(P/S) 



Other Variables Based , *(P) 

On Estimates Provided 

by Education* Department = ■ 

Staff 

a In Tasmania separate indices were prepared for Primary CP) an d 
Secondary CS) -Schools, 

b Variables used by New South Wales , n^stern Australian and Tasmanian 

non-government systems have not been used to construct indicators. Thes 
variables have been listed in Appendix A* The Queensland non- 
government system does not .gather data on any variables. 

Source: Ross (19801 . 



Table 2*3 The Sources of the Data Used to Construct Indicators \y 
for Australian School Systems During 1980 



Da - Source * ' Government Non -Government 

NSW Vic" Qld SA WA Tas Vic SA 



L ' *©1 

IHiucat xon^ Dep ar t men t~ 

Australian Bureau 
of Statistics 

Department of 
Social Security 
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* . The number of data source's ranged from a maximum of three in the 
Western Australian government system to a minimum of one in the New South 
Wales and Queensland government systems* and the Victorian and South 
Australian non-government systems , 

the Western Australian and la s man i an government systems were the only 
systems to obtain information from outside agencies. Both of these systems 
used** information obtained from the Australian Bureau of Statistics, The * 
Western Australian government system supplemented these data with inform- 
ation obtained from the Department of Social Security* 

The importance of the indicators in the final selection of schools 
" varied marked 1 y " aero I s t h e schoo 1 syst ems. " At ' one "extreme ,' the Victorian 
government system placed almost complete dependence on the rank order of 
schools developed from its indicator. _ A cutting score on the indicator 
was selected by cumulating the student enrolments of the schools which were 
most disadvantaged until the cumulative tally of enrolments reached the 
total number of students which were permitted by the Schools Commission to 
participate in the Victorian Disadvantaged School Program, All schools 
above this cutting score were then included in the Program with the exception 
of schools either slightly above or slightly below the cutting score. The 
decision to include these schools was talcen following a review of their 
characteristics by a committee that was responsible for the administration 
of the Program in Victoria, There was no attempt to rearrange the balance 
of participating schools between, for example* primary and secondary schools f 
or metropolitan and non-metropolitan schools, - \ 

In contrast, the Queensland government school system determined a list 
of, disadvantaged schools through a series of reviews carried out by the 
" ' members oTTTTsp cei a 1 task force" who possessed a dot axl e d know ledge of '•- - - 
Queensland" government schools, A list of schools was\initially constructed 
by making use of information obtained from regional directors of education, 
inspectors and school principals. Whenever some doubt arose concerning a 
particular school, the indicator score of that school was -consulted only as 
a supplementary piece of information, This list was then repeatedly 
refined by the task force by obtaining further information f\om informed 
persons j or by the members of the task force making .visits to vthe schools. 
This review continued until the cumulative tally of enrolments of the 
remaining schools reached the total number of students that were permitted 
to. participate in the Queensland program, 



, ■■ * Summary 

In this chapter a review has been presented of the resource allocation 
responses which have been made in Australia to the changing concept of 
equality of educational opportunity, 

The changing nature of the concept of equality was discussed within 
a' framework, developed by Husen (1972, 19753 $ that was linked to three 
distinct social philosophies i conservative j, liberal, and redemptive. 
A detailed examination of the interpretation of the concept of equality 
presented in reports prepared for the Australian Schools Commission showed 
that federal assistance provided to educationally disadvantaged schools in 
Australia has been guided by a mixture of liberal and redemptive philosophies 

The federal assistance to educationally disadvantaged schools has been 
channelled through the Disadvantaged Schools Program since 1974, Initially,*^ 
schools were selected to participate in this program by means of a national 
indicator of educational disadvantage based on census data, However, in 
recent years, responsibility for the identification of disadvantaged 
schoo_ls been assumed, by the scho ol, systems . 

In 1980 there were eight different indicators being used to identify 
disadvantaged schools in Australia: one for each of the six State govern- 
ment school systems, and one each for the non-government (Catholic) school 
systems in Victoria and South Australia* In most of the other, non-government 
school systems a wide range, ©f objective data has been gathered but no 
attempts have been made to combine these into indicators* 

A review of the techniques which had been used by Australian school l 
systems to construct indicatois of educational disadvantage showed that there 
was little consistency across school systems with respect to the types of 
data used to construct these indicators. Further, the school systems had 
generally ignored the issues of indicator validation and the development of 
measurable external validation criteria. The construction of the school 
system indicators had mostly been based on appeals to jface validity and had 
been guided by the opinions of committees of 'experts 1 , 



CHAPTER 3 



THE ACCURACY OF RESOURCE ALLOCATION STRATEGIES 
AIMED AT ALLEVIATING EDUCATIONAL DISADVANTAGE 

Introduction 



.The history "of programs "aimed at alleviating educational disadvantage has 
featured a common concern with respect to the accuracy associated witlj 
the delivery of supplementary educational resources and services to. those 
students who were most in need of assistance* 

In the United Kingdom the precision of the procedures employed to 
identify disadvantaged Educational Priority Area schools was subjected to 
heavy criticism by Acland (1971) following a reanalysis of the data 
collected for the Plowden Committee, Acland concluded that 'there is some 
concentration of 'slower* children in the E.P.A. [Educational Priority 
Area] schools. But the difference is not educationally exceptional' 
—(Acland, I£m^6e)— ^Vratcr study by Barnes and Lucas (1974) conducted 
in London schools presented a similar conclusion: 

It seems likely that the majority of disadvantaged children 
are not in disadvantaged areas and the majority of children 
in disadvantaged areas are not disadvantaged, 
. (Barnes and Lucas § 1974:56) 

Criticism of the accuracy of resource distribution has also been 
directed at the selection procedure for disadvantaged Title I schools in 
the United States, Glass (1970) and Fortune (1971) showed that an income 
dichotomy for family incomes, as was used in the Title I program, was a 
very imprecise method for identifying 'students having reading and learning 
difficulties. Later research and criticism led to'attempts to change the 
distribution of resources from the selection of schools on the basis of 
social criteria to the selection on the basis of performance on criterion- 
referenced tests CBmrick, 1974| Quie, 1974), Feldmesser (1975) has 
. presented a comprehensive review of the dangers associated with the use of 
test scores to guide resource allocation strategies for programs def 



med 



to assist educationally^dis advantaged students. In particular he emphasized 
the problems of a 'disincentive effect' - . - in which schools may be tempted to 
manipulate student test scores to give the appearance of low performance, and 
thereby guarantee continuity of supplementary assistance. 



Tho problem of obtaining accuracy in the delivery of resources to 
those students attending educationally disadvantaged schools who are in most 
need of assistance is not solely a question of choosing the ' correct * 
indicator. Consideration must also be given to the approach of selecting 
schools, rather than individual students s as the units of fu/.jing. 

Since there will generally be some dv^-eo of ^ rL ; ; , ;n i n student 
characteristics (abilities, home envix^,7]me*nts, etc, / bioth between schools 
and between students within schools s th© *■ sanation of certain schools or 
groups of schools to be the recipients of supplementary resources will 
always lead to some needy stjdents being unable to receive assistance 
because their schbol or j^oup of schools was not selected to participate in 
the program. For example* if the distribution of the criterion measure of 
disadvantage was associated only with variation between students within 
schools then all schools would contain approximately the same proportion 
of disadvantaged students. In this situation resource allocation based 
on the selection of schools or groups of schools would be extremely inaccurate 
Conversely » if the distribution of the criterion measure was associated only 
with variation between schools then the selection of schools or groups of 
schools with the lowest mean scores on the criterion would result in 
completely accurate resource allocation. 

The two extreme examples described above specify the boundaries for a 
consideration of the accuracy of resource allocation programs associated 
with the funding of disadvantaged schools in Australia, The unit of ident- 
ification and funding for all Australian school systems has been the school 
because the definition of ^disadvantaged* prepared by the Australian Schools 
Commission at the commencement of the Disadvantaged Schools Program 
incorporated this notion, , 

In the following sections of this chapter the implications of the 
choice of the school as the unit of identification and funding have been 
examined. In particulars consideration has been given to developing 
quantitative estimates of the accuracy with which resources may be delivered 
to individual students when a 1 school -based* funding program is adopted in ■ 
= Qrder-^tO-asslsc_educatloita 1 1 y— dlsadvan taged -student s J , : — 



47 



* Definition of T erminology: Accuracy ^and Leakage 

=— *-™^ — ~ " " - * 

In the following discussion the precision with which educational resources 
may -be delivered through a school-based procedure to those students who most 
need them has been described in terms of two statistics: Accuracy and 
Leakace. The term * school -based 1 has been used as a summary description 
of the procedure used both by the Australian Schools Commission in its^^ q 
initial 1975 allocation of resources to disadvantaged schools, nnd^by 
Australian school systems in the years following this initial allocation. 
In brief, this procedure has been based on the development of an" ordered 
list of schools according to school mean scores on an indicator of dis- 
advantage followed by the allocation of resources to a grow/of schools who 
are lowest on this list, ■ The cutoff points for selecting ihc lowest group 
of schools have been obtained by limiting the number of participating 
students to a percentage within the range of 10 to 20 per cent of total 
enrolments. 

The Accuracy co efficient for an individual school describes the degree to 
which a school at a given percentile on the distribution of school indicator 

^OTOs-coninrin 
educational disadvantage. 

For example, consider a school at the 20th percentile on the cumulative 

. distribution of indicator scores for schools. The Accuracy coefficient for 
this school, A(10, 203, with respect to student scores on a measure known 
to be associated with educational disadvantage refers to the percentage of 
students in this school who are below the 10th percentile for the overall 
cumulative •distribution of student scores on this measure . 
The Leakage coefficient borrows its name from the concept of 'resource 
leakage* used by Benson et al (1974:85) to describe a situation when 'too 
much money leaks to students who are doing well enough by ordinary standards' 
In this chapter, students have been considered to be doing 'well enough 

"by ordinary standards * when they have obtained scores on a measure known to 
be associated with educational disadvantage which are above the median (50th 
percentile) for the overall cumulative distribution of student scores on - 
^tli^ s^mfeasur e — - — — - -.- ' ' - 



For example, consider a school at the 20th percentile on the cumulative 
distribution of indicator scores^for schools. The Leakage coefficient, L(2Q) 
with respect to student scores on \measure known to be associated with 
educational disadvantage refers- to the percentage of students in this school 

; . ; 35, . - ' • ' . : 



who are above the median for the overall cumulative distribution of student 
scores on this measure, 

Factors Influencing Precision^ in jte^qurce Allo cation 

The values of the Accuracy and Leakage coefficients for particular schools 
depend on the nature of the allocation of students among schools* This 
may be demonstrated by considering "the following simple hypothetical example 
in which two different arrangements of the same population of students among 
ten schools have been compared, These two arrangements have been presented 
in diagrammatic form in Figure 3,1, 

The ranges of student scores within each school for each arrangement 
have been . represented by. vertical lines in Figure 3.1. The school mean 
scores were represented by dots in the middle of each of these vertical 
lines. The ranges of school mean scores for each arrangement may be examined 
by considering the distance between the highest and lowest school mean scores 
within each arrangement. 

In order to facile' ate comparisons between the arrang^^ts the follow- 
ing simplifying assumptions have been madei 

1 Assume that the overall distribution of student scores, the ^ ~ 
distributions of student scores within schools , and the distributions of 
school mean scores are all normal distributions, 

2 Assume that, within each arrangement, the distributions of student 
scores within schools are identical. 

The total variance of student scores was the same for both arrangements 
because the same population of students was being considered in each arrange- 
ment, However the variance of school means and the variance of students 
within schools differed widely between arrangements. 

In arrangement I there was a large degree of variation LBtween school 
means and a small degree of variation between students within schools, * In 
arrangement II the relative magnitudes of these two sources of variation 
have been reversed, To summarize these characteristics we could say that 
arrangement I showed a high level of student homogeneity within schools, - 
and arrangement II showed a high level of student heterogeneity within schools 

Since the same popu la t ion of s tu den t s was being con s i dere d "in e; Sell ["T"" 
arrangement, the raw score equivalents of student percentile^ ranks' was the 
same for both arrangements* An inspection of Figure 3,1 showed that this 
was not the case when school mean percentile ranks were 4 compared across 




arrangements, For example, the raw score equivalent of the 20th percentile 
for school means was much lower in arrangement I than it was in arrange- 
ment II. 

The Xth percentile for students, which had the same raw score equiv- 
alent in both arrangements t has been shown. in- Figure 3.1. The 'school 
locations' of students below this percentile differed markedly across the 
two arrangements. In arrangement I the students below the Xth percentile 
For students were located in the lowest three schools, whereas in arrange- 
ment II these same students were located in all schools. From Figure 3.1 
it could therefore be seen that in arrangements where there was a high level 
of homogeneity of students within schools, the students below a particular 
percentile value for students would generally be located in fewer schools 
than for arrangements where there was a high level of heterogeneity of 
students within schools. 

The above discussion may be used to examine the implications for 
precision in resource allocation programs when school mean scores are used 
to select students who are to benefit from these programs. 

Consider a resource allocation program in which the selection^ of 
students to receive the benefits of supplementary funding was based on the 
school mean scores of a student derived measure, The student derived 
measure could, for example, be test scores on an instrument designed to 
measure basic literacy skills, or.it could be a composite measure of 
indicators which were designed to assess the educational environment of 
each student's home circumstances s Also' consider that the student derived 
measure was an adequate measure of educational disadvantage for individual 
students, and that a low score indicated high disadvantage. \ . 

I f there was a high-level of homogeneity of students within schools, 
as for arrangement I, then the lowest scoring students would be located 
within a relatively small number of schools. The schools whose mean scores 
fell below -the given percentile cutoff, for example the 20th percentile for 
schools* would generally have relatively high values for the Accuracy 
coefficient and relatively low values for the Leakage coefficient. 
Conversely, where there was a high level of heterogeneity of students within 
schools, as for arrangement II, then the schools below the given percentile 
cutoff would generally have relatively -low values for the, Accuracy coeff- 
icient and relatively high values for the Leakage coefficient. 
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Those results indicated that, where the school was used as the unit 
of Finding, the precision with which the benefits of a program of supple- 
mentary funding for educational disadvantage" reached those students who 
were in most neird of assistance depended upon the nature of the variation 
in student characteristics within and between' schools* 

Relationshi ps between Accuracy^ Leakage, and Student 
Variation Within and Between Schools/ 

In the following sections of this chap'ter a quantitative measures the 
coefficient of intraclass correlation, has been employed as a, means of 
examining the components of student variation within and between schools^ 
This statistic provides a measure of the 'homogeneity 1 of student scores 
within schools* 

This statistic has been initially defined in, terms of the data available 
for this study and then examined with respect to certain limiting cases. 
Relationships between the coefficient of intraclass correlation and the 
Accuracy and Leakage coefficients have subsequently been developed* 

Notation 

The following discussion describes the notation used in later sections of 
this chapter- The arguments which have been presented have drawn upon the 
theoretical analysis of intraclass correlation given by Kish (1965:166-178), 

Consider a population of A schools each having B students* Also ■ 
consider a student measure Y 0 g obtained for student & in school a of this 
population, Let the mean score for school & be Y a and the overall population 
mean score be Y\ The variance of student scores fo^. the population (s 2 ) 
may be broken down into the sum of two components t * the variance of the 
school means around the population -mean (o a ^) s and the mean of the^ variances 
of student scoTOS=a=round their own school means (ob z ) - " ! ■' s . 

In Y notation this summation of variance components (a 2 - a a 2 + ob 2 ) 
may be written as : . 

'iEEcv aB -?)2 = l £ ( y y) 2 + iElEcv a -Y3 2 : 

AB aS A « a A. a B B aB a 

V The coefficient of intraclass correlation, Rho, which measures \ the 
homogeneity of student scores within schools is defined' as the product- 
moment correlation between each of the B(B-i] different pairs of student 
scores within - each of the A schools: 2 .' .■ j 



A a BCB-l] S<Y J ■ ' 

. 0 - 

* When student scores within the same school tend, on the average, to 
deviate in the same direction From the population moan, the average of 
the products and hence, Rho, tend to be positive** , 

it may be shown (Kish s 1965:1713 that the above expression for Rho 
is equivalent to: * - 

Rho * o a 2 - ob 2 /(B-l) 

* — " _2 ~ • 1 "^v 

Q 

There are three special cases of Rho which describe particular arrange- 
meats O^f students among schools: * . , 

1 Complete homogeneity of student scores within schools occurs when 
ah 2 = 0 and o a 2 o 2 . In this case Rho * 1. t 

2 Extreme hetoroflonoi ty of student ^scores within sjchools occurs when 

o a 2 ^ 0 and a 2 - a 2 * In this- case Rho - -1 „ 1 

8 (B-l) • 

3 Random s ort ing of student scores among schools occurs when the 
relationship between o a 2 .and ob 2 is as if each school was composed of a 
random selection of B students, In this instance the relationship between 
a a 2 and ah 2 is obtained from the expression for the variance of the sample 
mean under the assumptions of simple random sampling (Kish, 1965 s -167} : 

_ n 2 . 

4 The resultir^ value of Bho is ■ This value tends to zero for f 

large populations. : ' >^ 

Within-Schooi Deviation Scores and Percentile Ranks * ' • 

By using the assumptions described in a previous section concerning a ? 
population of students and schools, the relationship between a student's 
within-school deviation score or percentile may be linked to his/her overall 
deviation score or percentile in a functional form which depends oh the 



coefficient of intraelass correlation. 

In the following discussion the overall? distribution of student scores 
has beofi assumed to be scaled so that the overall mean, Y, is equal to zero. 
From the previous assumptions concerning the distributions of student and 
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Figure 3,2 ? A Possible Arrangement of Student, School Mean, -and Overall 
Mean Scores * ■ * 



school scores, the mean of the school scores will also be zero jind the- 
variances of student scores within schools will be equal (o b ) for all 
schools. 

Consider a student with a score of kj/o units, where ki is a constant. 
This. student's score would be situated at ki student standard' deviation 
units from the overall mean of student' [and school) scores, _ , ^' 

Let the mean score of the school which this student attends be k 2 0a 
units, where k 2 is a constant. This school's mean store would be* k 2 ^ 
school mean standard deviation units from the overall mean of student 
(and school) scores. ' ^ *.'=■- 

Figure 5.2 shows one possible arrangement of the distribution of scores 
within a particular school. In this example the school mean score is below 
the overall mean. Also, the particular student's score is below both of 
these scores . 



The deviation score* # f o 
-mean— Is*— — ^ — 



f this student with respect to his own school 



y = Student Score - School Mean Score 
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The standard score, i, of this student With respect to the 

distribution of student scores within his lown school is : 

i 

i - Student Score - School Mean Score 



Standard Deviation of Scores Within School 

Student Score in School Mean Score In 

= Within-School Standard - With in -School Standard 
Deviation units . Deviation Units 

Since the distribution of student scores within schools is assumed 
to be normal, the proportion of students in this school who score at or 
below the score of this particular student is* 



Proportion of students at _ J 1_ e 2 di 
or below i in this school 



Area of the shaded 
region in Figure 3,2, 



From previous discussion of the equations which relate a 2 , .u g 2 , Q^ 2 
and Rho , the values, of o 2 and oj' may be expressed in terms of o^ 2 and Rh 

a? ' Bo b 2 and o 2 - [1+Rho (B-l) ]a 2 

_ a ,• _ g 

(B-l) (1-Rho) / (B-l J (1-Rho] 

Further substitution of these expressions into the equation which 

\ 

defines 2 gives an expression, for \e which eliminates the variance terms: 



a « k 



r ' b I? . [ \i * RhofB-n |g 

1 (B 1) (l-Rho) *~ • (B-l)(l-Klio)J 



\ 
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When tliis value of a is used as an upper limit in the above integral 
of the normal distribution, the value of the 'proportion of students at or 
below i in this school * becomes a f?inetion of kj, ka* B and Rho, Further, 
by multiplying both sides of the integral by 100 it is possible to restate 
the expression in terms of percentiles: 

Wi thin-sc-hool percentile 

rank; corresponding to a = 1QQf £k fc B> RhQ) 
within-school standard * ■ 

score of i 

where f = the area under the unit normal curve between the limits 
of -** and the value of i described above , 

Accuracy Coefficient for Individual Schools 

Consider a student whose score* is at the pith percentile in the overall 
distribution of students scores. Let this srudent be a member of a school 
with mean score at the pgth percentile in the distribution of school mean 
scores, 

The value of the Accuracy coefficient , A(Pi,p2) s for a school With 
mean score at the path percentile for schools is the percentage of students 
in this" school whose scores are below the pith percentile for student scores 

From previous discussion the Accuracy coefficient may be expressed as: 

■MP1.P2) = lOOf (kj .ka.B^ho) 

where kj = the standard score equivalent of pi- 
where" k2 = the standard score equivalent of p2« 

For example, A (10* 20) is the percentage of students in a school s with 
mean score at the 20th percentile for schools, whose scores are below the 
10th percdntale for students. 

Assume, a Rho value of 0.2 and a value of B uqual to 23,6* This value 
of B was selected for this example because it was equal to the number of 
students per school in the samples which were employed in later chapters of 
this study, ^ , . . 

Use of these values and substitution in the formulae presented in 

\ i - . ~ ~ """" 

previous discussion gives the following: X 



Student Score in 
W.i thin-School Standard 
□aviation Units at 
10th Percentile 



School Mean Score in 
Within-School Standard 
Deviation Units at 
20th Percentile 



Within-School Standard 
Score 



-1, 



fc B > . 

[(B-1J (l-Rlio) J 

28 r 23,6 -H k 

LC23.6-l)Cl-0-2)J 



-1 ,46 



-0,84 

-0,46 
-1 .00 



f i+Rho'tB-l) Ik 
[jB-l)"U-Rho) J 

1+0,2(23.6-1) *lh 



and ACpi^Pa) = 100F (k x ,k 2 ,B ,Rho) 

-1 .00 ^i 2 
A(L0.20) - 100 I I c - da 



100 J 1 e 2 
J /2* 



\ 



15, § s 



That is, given the values of B and Rho described above, there are 15*9 
per cent of students below the 10th percentile for students in a school with 
- a~ mean- score at the - 20 th percentile for schools 7—— — • - — — — i 

The above set of calculations was repeated for the four possible 
~ ~ • - \ 

Accuracy coefficients which arise when pj and p2\take values equal to either 

the 10th or 20th percentiles. The results' of thes^e calculations have been 

summarised in Tab/le 3.1, For each value of Rho, student scores and school 

mean scores in within-school standard deviation units nave been presented 

for the 10th and 20th percentiles, \^ : 

In Table 3*1 values of the four Accuracy coefficients havesbeen^ listed, 



according to Rho values which range from 'extreme heterogeneity 1 tb^ 
'complete homogeneity 1 » 
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Table 3*1 Accuracy Coefficients for Individual Schools at the 10th/20th Percentiles for Schools, and Students 
■ '•' Below the 10th/2Qth Percentiles for Students 



Rho Student Score "School Mean Score Accuracy Coefficient 



{% units) : {% units) A(p ly p 2 ) 

10th Percentile 20th Percentile 10th Percentile 20th Percentile A(I0,10] A(10,20] 4(20,10) A(20 ( 20) 





rur jtuuynt^ 
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10 0 


20 0 


20 0 
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"U# 00 


-fl 77 


-fl Ifi 


14 Q 


12 9 


27 7 


24 7 


n l 




■u.sii 


"11.51 






14 R 




28 4 


U.i 


-1,40 




fl 71' 


-fl 47 




15 Q 

i « i ? 


40 0 


31 0 




1 E7 




fl Qfl 


-fl w ■ * 


25 7 




44 9 


33 1 


0,4 


-1.69 


-1.11 


1 1 ft 

-1,10 


ft ^ # 

■0,73 


27.8 


10, 7 




?C ft 


0.5' 


4. 8S 


-1.22 


: 4.34 


, -0.88 


30.3 


16,5 




36 « 


0,6 


-2.07 


-1.36 " 


-1.63 


-1,07 


32.8 


15.1 


§0,5 


38,5 


0J 


-2.39 


- 4.57 / 


-2.02 


4.33 


35,5 


14.3 


67.3 


40,3 


0,8 


"-2.93 


-1.92 


-2,63 


4.73 


38,4 


11.5 


76,1 


42.3 


0.9 


-4.14 


4J2 


-3,94 , 


*2.59 


41.9 


6,0 


aa.a 


44,7 


l,0 a 


. J , 


b 


b 




50,0 


0,0 


100.0 


50,0 



.Note: a The value of the coefficient of intraclass correlation (Rho) for 'extreme heterogeneity' of student scores 
• within schools is 4/22.6; for ''random sorting' of student scores among schools it is 0.00; and for ,'comple 
homogeneity' of student scores within schools it is 1.0 (for infinitely large papulations of schools), Hot 
that the valuei *-f Rho for 'extreme heterogeneity' and 'complete homogeneity' are limiting cases, 

b The liinitine values for these scores have been = discussed in' B« ■ 

c The Accuracy values vert calculated by uiing PROGRAM NORMAL, (See Appendices C and D)« .: 



For example, when Hho « 0.2, the coefficients AC 10 , 10) , A( 10 ,20) s 
Af.20,10) , and A(2G,20) took the values 22.5, 15.9, 40.0, ami 31,0 respect- 
ively. These values may be interpreted in the following fashion: A school 
with mean, score at the 10th percentile for schools has 22,5 per cent of 
its students below the 10th percentile for students and 40,0 per cent of 
its students below the 20th percentile for students; whereas a school with 
mean score at the 20th percentile for schools has 15,9 per cent of its 
students below the 10th percentile for students and 31 per cent of its 
students below the 20th percentile for. students, 

The values of Rho which represent 'extreme heterogeneity 1 and 'complete 
homogeneity* are limiting cases. In fact it would be impossible to calculate 
values of Accuracy or Leakage coefficients if Rho took either of these values, 
'Extreme heterogeneity 1 , would result in all schools having the same mean 
score which would prevent the calculation of percentiles for schools* 
'complete homogeneity 1 would result in all students within a particular 
school having the same score which would prevent the calculation of within- 
school percentiles. These limiting values of Rho and the resulting values 
of. the Accuracy and Leakage coefficients have been discussed in detail in 
Appendix B. 

A computer program, PROGRAM NORMAL s was prepared to calculate Accuracy 
and Leakage values for schools at each percentile from the Oth to the 20th 
percentiles. This program has been listed in Appendix C, Some examples 
demonstrating the output from this program for a range of Rho values have 
been presented in Appendix D. > 

The Leakage Cqefficient for Individual Schools , 

The Leakage coefficient may be co n s i d e r e d a s a 8 pe c ial c a s e ' o f the Accuracy " ■ 
coefficients 

Consider a student whose score is equal to the median of the overall 
distribution of student scores , From previous assumptions, this student's 
score would also be equal to the mean of the distribution of school mean 
scores. Let this student be a member of a school with mean score at the 
pgth percentile in the distribution of school mean scores, 

The value of the Leakage coefficient f L(p 2 )\ for a school with a mean 
score at the Path percentile for schools is the percentage of students in 
this school with scores above the overall median for student scores. 
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The leakage irovf fie iunt is related to the Accuracy coefficient by the 

following expression : 

Up 2 ) - 100 - A(S0,p 2 ) i 
The value of pj in the Accuracy coefficient is fixed at 50 because 

this is the percentile equivalent of the median of student scores. 

Then, from previous discussion 
L(p r ) = 100(l-f (0,k 2t B f Rho) ) 

The value of k t in the function f has been fixed at zero because, from 
earlier assumptions, this is the standard score equivalent of the 50th 
percentile, 

.' F-or example, L(2Q) is the percentage of students in a school, with 
mean score at the 20th percentile for schools, whose scores are above the 
50th percentile for students, Assume a Rho value of 0,2 and a value of B 
equal to 23.6. This value of B was selected for this example because it 
was equal to the number, of students per school in the samples which were 
employed in later chapters of this study. 

Using these values and substituting in the formulae presented in 
previous discussion gives the following: 



Student score in 
Within-School Standard 
Deviation Units at 
50th Percentile 



^1 P. B 1 H 
l(B-i) Cl-Rho)J 



0 for all values of B and Rho 
because ki=0 for the 50th 
percentile , 



School Mean Score in 
Within-School Standard 
Deviation Units at .the 
20th Percentile 



f i+RhoCB-q) l h 
I CB-1) (l-Rho)J 



-0,84 rU0.2C23.6-lD 

-. (_(23.6-l) (1-0- 2)_ 



-0.46 



.n GO 
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Within-Schooi 
Standard Score 



0*(>0. 46 ) 



0 ,46 



and 



LCp 2 ) 



100(l-f (o,k 2 »B t Rlio) 



0.46 



L(20) 



i 



e 



di) 



100(1-0.6791) 



32,1 



That is s given the values of B and Rho described above, there are 
32^U=pep cent of students above the 50th percentile for students in a 
school with a mean score at the 20th percentile for schools, 

The above set of calculations was repeated for Leakage coefficients 
at the 10th percentile and the 20th percentile. .For each value ©f Rho* 
the school mean scores in withln-school standard deviation units have. been 
presented for the 10th and 20th percentiles in Table 3,2. The two 
Leakage coefficients have been listed according to Rho values which range 
from 'extreme heterogeneity* to 'complete homogeneity 1 = - 

For examplej when Rho = 0,2* the coefficients L(10) and L(20) were 
23,9 and 32,1 respectively, These values may be interpreted in the following 
fashion. A school with mean score at the 10th percentile for schools has 
23.9 per cent of its students above the 50th percentile for students; 
whereas a school with mean score at the 20th percentile for schools has 
32.1 per cent of its students above the 50th percentile for students. 

( Average Accuracy and Leakage for Groups of Schools . 

The previous discussion was concerned with the calculation of, Accuracy and 
Leakage coefficients for individual schools, The average of the Accuracy 
and Leakage coefficients over groups of schools may be used to provide 
information about the precision with which indicators may be employed to 
identify groups of schools having students with certain ranges of educat- 
ional achievement . 
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Notr a The value of the coefficient of ihtncllfi correlation (Rho) for 'extreme neterogeneity of 
student scores within schools is -1/22.6: 'ranriofli sorting' of Student scores among schools 
it is 0' 00; and for 'complete, togeneitf of student scores within schools it is 1.0 (tor ■ 
, infinitely largo populations of schools) , Note that the values of Rho for. 'extreme heterogeneity 
and 'cornpletD homogeneity' are limiting cases. •. , / 

b The limiting values for these scores have been discussed in Appendix B. . 

i I 5 1 ■: 

, v c The Leakage values were calculated by using PROGRAM NORMAL, (See Appendices C and D) , 



For example, consider the average value of A(20, p' 2 J over the group 
of schools from the school at the 20th percentile- down to the lowest school. 
This statistic estimates the average school percentage of- all students who 
are In schools below the 20th percentile for schools and who are also 
below the 20th percent i le for students overall. 

Similarly, consider Jthe average value of L£p 2 ) over the group of 
schools from the school at the 20th percentile down to the lowest school. 
This statistic estimates the average school percentage of all students who 
are in schotls below the 20th percentile for schools and who are also 
above the SQvh percentile for students overall. 

Estimates of the average Accuracy and average Leakage- coefficients 
have been presented In Table 3.3 according to a range of values for the 
coefficient of intraclass correlation. These values wore obtained by 
taking the mean of the relevant Accuracy and Leakage coefficients for 
schools situated at one percentile intervals. That is. the estimate of 
the average value of A(20, p 2 ) for schools below the 20th percentile was 
Obtained by evaluating the Accuracy coefficient for' an individual sch ° o1 
. at the 20th percentile. 19th percentile. 18th percentile, and so on . A 
similar approach was employed to estimate The average values of the 
Leakage coefficient. The 10th and 20th percentiles for schools were 
chosen as appropriate -cut-off points for calculating the average coeff- 
icients because these percentiles represented approximate upper and lower 
bounds for the percentages of students who have participated in the 
Disadvantaged Schools Program in Australia. 

The average coefficients In Table 3.3 may bo used to examine the 
precision in resource allocation which would be associated with programs 
which use schools as the unit of funding. 

For example, consider a school system in which Rho = 0.8 for a measure 
derived from students which was designed to assess educational disadvantage 
This school system would be described as having a high level of student 
homogeneity within schools. Now consider a funding program which, was 
<U reeled at the lowest 10 per cent of schools with respect to the school 
mean scores on the same measure of educational disadvantage. - From Table 
3.3 it can *be seen that, for this resource, allocation program, there would 
be about 90 per cent of students within funded schools who would be below 
the 20th percentile for students. Also, about 70 per cent of the students, 
within funded schools would be bolow the 10th porcentile, and less than one 
per cent would- be above, the median score for the whole, population of. . 



lab 1 e 3 , 3 A v t? r a ge Accuracy and Leakage Coefficients for Schools At 

o r Below the 10th/2Qth Percentile for Schools, and Students 
Below the 10th/ 20th Percentiles for Students 
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Note % a The value of the coefficient of intraclass correlation (Rho) for 

•extreme heterogeneity 1 of student scores within schools is =1/22, 6» 
for 1 random sorting 1 of student scores among schools it is 0,QQ; 
and for 'complete homogeneity 1 of student scores within schools it 
is 1,0 (for infinitely large populations of schools). Note that 
the values of Rho for f extreme heterogeneity* and 'complete 
homogeneity 1 are limiting cases. " 
.' fa The limiting values for these scores have been discussed in 
Appendix B. — 
c The Leakage values were calculated by using PROGRAM NORMAL, 
(See Appendices C and^D), . ' 

students . These results could be summarized by saying that, the use of 
schools as the unit of funding for this population of students and schools 
would provide a relatively accurate delivery of resources to those students • 
who were in most need of assistance. 

If the population described above was compared with another population 
in which Rho is equal to 0.1, then the use of schools as funding units 
leads to a much less accurate delivery of resources to the individuals who 
would be in most need of .assistance , In this population there would tea 
high level of student heterogeneity within schools/ If. resources were 
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directed to the lowest 10 per cent of schools in this population, then U ; 
than one half of the students in funded schools would be below the 20th 
percentile for students* Furthers less than one third of the students 
within funded schools would be below the 10th percentile, and almost one 
quarter would be above the median score for the population* 

Application of the. Model; An Internation al Example 

In the following discussion the theoretical model described above has been 
applied to an international example in order to compare the precision of a 
hypothetical resource allocation scheme based on the funding of schools 
with low mean test scores. Test scores on a test of Word Knowledge have 
been used in this example because their statistical characteristics were 
readily available for a group of countries from the reports of studies 
carried out by the International Association for the Evaluation of Educat- 
ional Achievement (Thorndike* 1975; Peaker* 1975], If data had been readily 
available to permit the calculation of the coefficient of intraclass 
correlation for some other variable, for example* a measure of the socio- 
economic level of a student's home environments then the same principles 
^outlined in earlier sections could have been applied to compare different 
countries. The procedures employed to calculate estimates of the coeff- 
icient of intraclass correlation from sample data have been described in 
Appendix F* , • 

The comparison of average Accuracy and Leakage coefficients for the 
ten countries, examined in this example assumed that the aim of the 'school- 
based 1 funding .program would be to assist those students in most need of 
assistance as measured by their Word Knowledge test scores* For example, 
if the lowest 10 per cent of schools were funded then the 'optimal 1 level 
of precision would require average Accuracy and Leakage coefficients Oyf 
100 and zero, respectively. This situation would occur when -all students 
in the lowest 10 per. cent of schools were also in the lowest 10 per cent 
of students and none of these students were performing above the national 
median score* From previous discussion we would only expect this situation 
when the coefficient of intraclass correlation was equal to unity - 
signifying complete homogeneity of students within schools. 

From information presented by Thorndike (1973*142) it was possible to 
calculate estimates of the coefficient of intraciass correlation associated 
with the same test of Word Knowledge applied to nine countries at the 
10-year-old level and the 14-year-old level. The tests which wore used in 



the study described by Thorndiko consisted of the same tests at each age 
level after having been translated into mother-tongue languages for each 
country* 

The information for Australia was obtained from a study of Literacy 
and Numeracy carried out in Australian schools in 1975 (Keeves and Bourke, 
1976). In all ten countries similar target population definitions were 
used at each age level,. The values of the estimates of the coefficients 
of intraclass correlation have been reported in Table 3.4, Values of 
the Accuracy and Leakage coefficients have, also been listed in this table. 

For Austral ia, the coefficient of intTaelass correlation was 0*14 at 
both age levels. Since the value of roh was the same at each age level, 
the corresponding average Accuracy and Leakage coefficients were also the 
same,* !-or Australia^ in the lowest 10 per cent of schools the average 
Accuracy estimate showed that 33*1 .per - cent of these students would be in 
the lowest 10 per cent of students overall* The average Leakage estimate 
showed that 20,2 per cent of students in the lowest 10 per cent of schools 
would have scores above the national median score. 

The values of the coefficients of intraclass correlation were low 
for both age levels' in only three countries: . Australia, Hungary and Sweden 
^^Consequently each of these countries also had relatively low average 
Accuracy coefficients and relatively high average, Leakage coefficients. 
These results demonstrate that, compared to the other countries listed in 
Table 3.4 f these three countries would* have comparatively low precision 
in resource allocation schemes which used schools as the unit of funding* 

In comparison Italy, Sept land and the united States had relatively 
.high values of roh at both age 1 eve fiT anST therefore had high values for 
the average Accuracy coefficient and low values for the average Leakage 
coefficient. . These three countries would therefore be more appropriate 
settings for funding programs based on the selection of schools\with low 
mean scores . , , . • • ! 

Some anomalies appeared between age levels for England* Finland, , 
Israel and* the Netherlands ■* In these! countries the values of roh were%^ 
substantially higher for the 14-year-old level than for the 10-year-old s 
level. These results implied that s 'for these countries, a resource 
allocation program which used schools* as the unit of funding would be 
more appropriate at the secondary school level than at the primary 
school level. I 



Table 3,4 Coefficients of Intraciass Correlation and Average Accuracy/Leakage Coefficients 
' Over the Lowest 10 Per Cent of Schools for Ten Countries 
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N'ote: a The ratios of the variance of school means to the total student variance fNiy were reported bv Thonidike 

*• , . ' \ - •. ■ ; . ; ¥/ ' ; ■ / ; 

(1973:142} 'for- the Word Knowledge Test which wag employed cross-nationally as' part, of a series of studios, 
carried out by the International Association for the Evaluation of Educational Achievement. The average 
cluster sizes (b) were reported for the same study by Peaker (1975 : 120} . 

••■ b The calculations for Australia were based on the Word Knowledge Test scores 'gathered for this study, 

• ' " • ' . . ' I] ' 

v ■ f c The average Accuracy and U akage values wen 'Calculated by using PR06RAN ill, (See Appendices C and D)'/* " 



i He statistic 1 roh 1 is. a sample estiiate of \thS ;populatidn 3 yalup of .'Rho 1 • , (See Appendix F.J., 




Summary 

An this chapter the problems associated with obtaining precision in the 
deiiverv of, resources to students attending educationally disadvantaged - 
schools were examined. It was demonstrated that the approach of using 
schools as the unit of funding" required acknowledgement of- the influence 
of student var iat ionfw'I-fchi n And between schools on the precision with 

which educational resources could be delivered to those sfudents who were 

/; v 

in most need of assistance *. , * 

A theoretical mo\lel was introduced for the purposes of estimating 
the precision in the ie livery of educational resources to students when 
schools wore used as the unit of funding . This model quantified the 
degree of precision in terms, qf Accuracy and Leakage coefficients. A * ^ 
test of this model against empirical data has been presented in Appendix 

This theoretical model was applied to an international example- in 
order to show that the use of schools as the unit of funding may result 
in substantial differences in the precision of resource allocation across 
different types of school systems. For example.* Scotland ? Italy* and the 
United States appeared to be more appropriate settings for school -based 
funding than were the seven other countries which were considered. This * 
occurred because the homogeneity of f studenjs within schools was 
relatively high for, these three countries at both the primary and 
secon^mry levels of schooling. 
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CHAPTER 4 



THE DESIGN OF THE STUDY 
Int reduction 

The previous chapters have examined educational resource allocution 
responses in Australia to the changing : concept of equality of euu^*^onal \ 
opportunity, and also the implications of using schools as the units of 
identification and funding when these responses have been aimed at 
assisting students who attend educationally disadvantaged schools. This 
discussion has shown that the quest for accuracy in the delivery of 
resources to those students who are fiost in need of assistance must take 
into consideration that the performance of an indicator of <Mucat?on&i 
disadvantage may he strongly influenced by the nature of the scnool 
population to which it is applied, 

, In Australia , the many indicators of educational disadvantage which 
have been used to distribute resources worth millions of dollars as part 
of the Disadvantaged Schools Program have not been examined in terms of 
the accuracy with which they deliver resources to those students who are 

s 

most in need of assistance* Those indicators have been developed on the, 
basis of the - 'export 1 opinions of school system committees without ever 
having been subjected to a comprehensive assessment with respect to either 
the construct which tney purport to measure or the characteristics of the 
schools and students which they identify as being educationally 
disadvantaged, " 

In this chapter a program of research has been outlined which aimed 
to ^overcome the deficiencies of the aval lable^i ndicators of educational 
disadvantage 4n Australia, This prdgrap^fnvolv^d a review of the features 
of the indicators of educational disadvantage currently being used by 
Australian school systems followed by a plan fo^-^m^idevelopmeht , valid- 
at ion , and intensive examination of t>te properties of a\nat ionj^TTHUcator 
which was designed to b e_con sistent with the definition d^i^sadvantagigd ^ 
employed by the Australian School.? Commission to, establish the Disadvant- 
aged Schools Program, . 
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\hv IK't'inition of ' Disadvantaged! 



The emergence of a redemptive interpretation of equality in Australia was 
most strongly marked by the proposal put forward by the Interim Committee 
for the Australian Schools Commission to establish the Disadvantaged 
Schools Program (Karnicl, 1973). This program aimed to provide 'greater . 
than uvc rage resource? p to disadvantaged schools with the intention of 
'reducing differences in the educational performances of socially dis = 
advantaged children and the rest of /the school population 1 (Karmel, 
. yi=U\Uii ir>) / , 



At the beginning of the Disadvantaged Schools Program the Austral ian 

.Schools Commission provided a definition of the concept of 'disadvantaged 1 

in the following terms: / 

The Committee lias chosen the. term 'disadvantaged 1 in relation 
to. schools drawing ay high proportion of enrolments from 
ne i ghbourhoods having certain characteristics known to be 
generally associate.il with a low capacity to take advantage of 
educational facilities. i Karme 1 , Hl75i92) 



The first kev ido; 



\ Jhl s 



definition was that the term 'disadvantaged' 



was to he associated wi thf school s! and not individual students 1 * Thus , 
disadvantaged student was defined by being a student at a disadvantaged 
school. The ; second idea was that ithe definition was not conce/rned with 



the characteristics of 'the fa mill q s of students - but rather the 
* no ighbourhoods f ' f rfim which schools obtained their students, The third 
key idea was ; that /these nei ghbouriioods should display characteristics which 
were 'associated with' conditions .which wore adverse to making the best 
use of educational facilities* 

The 1 Proliferation of Indicators of Educational Disadvantage 

in\ Austral ia 



The initial lists of disadvantaged Schools were developed, by the Australian 
Schools Commission at a national leve^ in 1973 by employing a single 
indicator called the 'Socioeconomic Saale'. These lists were presented 
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to the school ; system in c 

the correction 5 of anv 

/ 

been expended both b* 

\ 

systems to update, m-^; 

/ . | j 

educational disadvant*. 



or \ comment and thenljadoption following- 
Since that time groat efforts have 
pols Commission' and the school 
cti a wide range of indicators of 
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By 11*80 then* were nine separate indicators of edueat ional disadvant- 
being used in Australia: one at the national IcvcT, one each for the 
six State Government school systems, and one each for the Non -Government 
school systems in Victoria and South Australia, Further, data describing 
a range of socioeconomic variables were being collected to assist with 
decisions concerning the identification of disadvantaged schools by the 
New South Wales * Western Australians and Tasmanian Non-tiovcrwncht school 
s y s t e ins - 

There appears to have been no pub Li shed evidence to explain in detail 
why the school systems rejected the notion of a national index of educat- 
ional disadvantage and instead set about the expensive and time-consuming 
task of developing their own indicators. The reasons which have been 
expressed in official documentation have, in a tangential fashion, 
suggested that there was a need for a 1 local 1 Indicator because the 

original national indicator was not able to identify disadvantaged schools 

i 

with sufficient precision (see references listed in Ross (1980)), This 
reason was the' most enthusiastically endorsed explanation presented during 
the author's attendance at a series of conferences on educational dis- 
advantage attended by representatives of all school systems (Australian 
Schools Commission, 1950b) a 

Th e Inadequacies Of the C urrently Ava ilable Indicators 
Of Educational Disadvantag e 

The proliferation of a diversity of indicators of educational disadvantage 
in Australia has not been accompanied by substantial efforts to assess 
the validity of the information provided by the indicator scores, There . 
appears to have been no systematic studies which have examined the 

'meaning 1 of the rank order of schools which these indicators have provided 

\ = 

In general, the validity of the indicators developed by school systems has 
depended solely upon opinions* provided by expert committees g concerning 
theTace validity of the component variables employed In the construction 
of the indicators (Ross, 1980), 

The consequences of a reliance on opinion, rather than objective 
procedures, has been that many indicators developed by the school" systems 
have, both departed substantially from the definition of 1 disadvantaged 1 
which was central to the Disadvantaged Schools Program-,, and also have no 
known relationships with other measures which could be considered to be 
symptomatic of educationally disadvantaged schools : 
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L An i impact ion o • l?c review of the indicators used by school 
systems presented in a previous chapter and in Appendix A showed that 
none of the indicators developed by the school systems closely satisfied N 
the definition of disadvantaged 1 , quoted in an earlier section, which 
was central to the . Disadvantaged Schools Program/ The major point of 
departure between this definition and the school system indicators was 
that the definition emphasised that degrees of disadvantage were to be 
assessed through an examination of the neighbourhood of the school 
whereas the school" systems developed indicators which were mostly. based 
on the characteristics of the families associated with children attending 
the school. The latter approach to the identification of disadvantaged 
schools was considered to be less desirable by the Australian Schools 
Commission because it would 1 Ignore the importance of the neighbourhoods, 
as an extension of the family, on children* (Karmel , 1973198), 

2 A second important point of departure between the definition 
and the school system indicators was concerned with the requirement that 
the information used to assess disadvantage should be restricted to 
characteristics associated with f a low capacity to take advantage of 
educational facilities*. The construction procedures for all = of these 
indicators were devoid of either the use of criterion variables or other 
information suitable for checking that the indicator components had been 
selected and combined according to this restriction. 

An excellent example of the dangers of .expert opinion was evident in 
the construction of the Victorian Government system's indicator of educat- 
ional disadvantage, In this indicator the variable measuring 'isolation 1 
was included with the intention that a high level of isolation was to be 
considered as evidence of a high degree of educational disadvantage. 
However, in a later investigation of the properties of this indicators 
this variable was shown to have a correlation with the indicator scores 
which was opposite in sign to the direction which had been expected 
(Ross; 1979a) . " . 

3 The construction of the. school system indicators has not been 
accompanied by any evaluations of the properties off the indicator scores, 
"For example, there appeared to be no published evidence concerning the 
capacity of- these "indicators to identify schools which have high concen-, 
trations of students who had either a low capacity to master the basic 
skills of literacy and numeracy, or a low capacity to overcome behavioural 
and. social handicaps which would inhibit personal development and 
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opporlun i l U*s for further learning. The lack of this type of information 
made it impossible to know exactly what the indicators were measuring - or 
if the approach of using the same indicator at both primary and secondary 
levels of schoolings which had been adopted by most school systems, was 
appropriate. Further, since there was no information available with 
respect to the capacity of these indicators to identify students who 
were in most need of assistance, it was not possible to assess the pre- 
cision with which the indicators could be used to allocate resources 
aimed at alleviating educational disadvantage, 

4 In addition to problems associated with the lack of congruence 
between the school systems* indicators and the Disadvantaged Schools 
Program's definition of 'disadvantaged 1 f and problems concerning the lack 
of validity information about the nature of the indicator scores , there 
were certain questions of administrative efficiency, public accountability, 
and invasion of personal privacy which surrounded the' use of separate 
indicators by the school systems, * ._ 

(a) The development of separate indicators has required that consid- 
erable amounts of money, time, and research expertise be expended by each 
school system on the development of their indicators. These replications 
of effort across Australia have to date been totally independent activities 
with little or no sharing uf experience, facilities and resources - even 
between government and non-government systems within the same state. 
Several non-government school systems were not able to develop their own 
indicators because they lacked access to the research expertise required 

to gather and process the required data. 

The independence of these activities has been reflected in the variety 
of approaches to indicator construction, For example 4 there was no single 
variable employed by all school systems in the construction of their 
indicators^ While this characteristic may be seen by some as an interest- 
ing feature of the diversity of the Australian education scene, it also 
exhibited a questionable approach to a program funded from federal sources 
and having a national set of aims covering all school systems, 

(b) The use of separate indicators by the school systems has raised 
questions of public accountability for the conduct of the Disadvantaged 
Schools Program, The program was funded from federal source* with the 
specific intention of assisting the "most disadvantaged Australian schools - 
irrespective of the State or school system to which they belonged, 
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After hJHM, l he Lick of n national indicator has made it impossible to 
compare degrees of edueat ional disadvantage for schools in different 
svstenis even if they are in the same State, The Schools Commission has 
made an attempt to overcome ihis difficulty by estimating degrees of 
educational disadvantage .it "he school system level, and then allocating 
funds according to differences between systems. However, it appears 
that this approach has simply moved more closely toward a per capita 
division of funds between sehrol systems (Schools Commission, 19SQb*14)* 

The indicator* which hav; been developed by the school systems have 
generally drawn up-.m ' . r.:i ir individual students, school records, and 
eduicaziou department files, The., data have then been subjected to an 
extensive series of calculations involving recoding, aggregation, and 
weighting, before they have entered the appropriate indicator, The = 
complexity of the data gathering and data manipulation activities required 
to builsJ these indicators have made it virtually impossible for persons 
outside the data processing sections in education departments to check or 
compare or* comment upon the indicator scores associated with even a few 
sch ool s ^ 

This approach to indicator construction has automatically removed 
any possibility of public discussion concerning the suitability of the data 
collection and indicator construction procedures.. However, in future, the 
pressures which are increasingly being exerted on the public funding of 
education will inevitably result in calls for indicators which are based on 
readily available data, and which are combined into indicators in a fashion 
that will permit members of the public to check calculations and discuss 
the appropriateness of various types of indicators. 

(e) The data used by school systems to construct their indicators 
has often relied heavily on the use of personal ' information gathered from 
students, This information has usually been obtained directly from 
students or from personal files and records kept by schools and school' - 
systems. In some eases the information has covered such extremely 
sensitive areas as the marital circumstances of a student's parents, th& 
student's race or ethnic origins, and the employment status of a student's 
father. 

In Australia there is currently a great deal of concern being 
expressed about the potential for invasion of personal privacy through 



the. storage ami man i pit 1 at ion of personal data with sophisticated computer 
equipment. These concerns may in future prevent the school systems from 
using data describing students and their i ami lies in the construction of 
indicators of educational disadvantage. One solution to the problem of 
personal privacy would appear to involve the use of census data because 
these data are widely available t provide a complete coverage of all 
Australian school neighbourhoods s and yet are aggregated to a level which 
is sufficient to prevent disclosure of personal information about 
individuals. 

The General and Specific Aims of the Study 

The general aim of this studv was to develop s validate, and describe the 
properties of a national indicator of educational disadvantage which was 
in harmony with the definition of 1 disadvantaged ' provided for the conduct 
of the Disadvantaged Schools Program in Australia, 

In order to develop this indicator several decisions were initially 
made with respect to the quantification of concepts contained in this 
def ini tion : , 

1 The definition was constructed in terms of schools and not 
students. Therefore schools were used as the unit of analysis in the 
construction of the indicator* i 

2 The definition emphasized that neighbourhoods were to be used, to 
describe the characteristics of disadvantaged schools rather than the 
families of students which attended disadvantaged schools, Therefore only 
information describing the neighbourhoods from which schools obtained 
their students was used to describe the schools* The description of 
school neighbourhoods was undertaken by obtaining, school average profiles 
from the census characteristics of the neighbourhoods in which students 
lived, No information derived from the characteristics of individual 
students or their families was permitted to enter the indicator* 

3 The definition required that only school neighbourhood inform- 
ation which was associated with a low capacity to take advantage of educat- 
.ional facilities should be included in the indicator, Therefore a criterion 
measure was required to be selected which would enable the selection of 
appropriate census descriptions of school neighbourhoods, The criterion 
variable which was selected was the school mean score on a tost of Word 
Knowledge which had been d^ /eloped l>y the International Association for 
the Evaluation of Educational Achievement (Thorndike, 1973), This measure 
was considered appropriate because it assessed the most central skill 



required to take advantage of educational facilities - the ability to 
understand the meaning of words used as part of the language of instruction 
in Australian educational institutions, 

The incorporation of these decisions into the general aim described 

above enabled the following more specific statement to be made with 

respect to the major concern of this study: 

To develop, validate and describe the properties of a national 
indicator to be used for listing schools according to, a measure 
of their school neighbourhood characteristics (based on census 

„_„ ^\ -descriptions of school catchment areas) which is optimally 

correlated with a measure of the capacity to take advantage of 
educational facilities (based on school mean scores on»a test 
of Word Knowledge), 

The planning of the development of this indicator had to take account 
of the previous discussion of the inadequacies of currently available 
indicators in' Australia, In particular it was considered important that! 
(1) the - indicator should be able to be used nationally in order to identify 
the most disadvantaged schools in, Australia, (2) the indicator should have 
known properties in terms of its correlates with other measures considered 
to be symptomatic of educationally disadvantaged schools, (3) the indicator 
should be checked in terms of the precision with which it can be used to 
allocate resources to those students who are in most need of assistance, 
(4) the indicator should be constructed from data in a fashion which 
ensured the maintenance of personal privacy, and which avoided the lack of 
public discussion associated with the widely used 'black-box' approach to 
indicator construction, (5) the indicator should be constructed separately 
for primary/secondary schools in order to take into consideration the 
possibility that the performance of an indicator may be influenced by the 
nature of the population to which it is applied, * 

The Units of Sampling and Analysis 

The data employed in this study were partially drawn from a national study 
conducted during 197S of the educational achievements of Australian 10-year- 
old and 14 -year-old students in the areas of reading, writings and numer- 
ation (Koeves and Bourke, 1976)**. The author was ; responsible for the design 
of the student questionnaire s data preparation and analysis, and the\ sample 
design evaluation for this study. The information obtained from this 
national study was used to develop criterion and validation measures with 
which to guide the construction of indicators of educational disadvantage. 




Data wcrv also obtained from the 1971 Australian Census of Population 
and Housing (CBCS, iy"l ) . These data permitted the development of detailed 
descriptions of the neighbourhoods surrounding Australian schools and were 
therefore used as the basic components in the construction of the indicators. 

The two bodies of data were combined together by linking each student's 
data to the data associated with the census Collector's District in which 
the student lived. These combined data were divided according to age level 
and then aggregated .over schools to obtain data files which would be 
appropriate for the between-schoo 1 level of analysis. Detailed descriptions 
of the sample of schools and students* and the procedures involved in the 
preparation of the data files prior to the construction of the indicators 
have been presented in Chapters 5 and 6, 

The appropriate unit of analysis for the development of the indicator 
was the school because this unit had been employed within the definition of 
' disadvantaged * . Therefore* discussion and interpretation of the results 
of these analyses has also remained at the hetweon-school level. 

In order to avoid problems associated with the 'ecological fallacy' 
(Robinson, 1930) it was not possible to infer that relationships between 
variables established at the between-schpol level would also apply at the 
between-s tudent level* However, the impact of the development of the 
indicators at the between=School level on the precision with which they 
could be used to allocate resources to individual students was examined 
in detai 1 . 

The Three Phases of Indicator Preparation 

There were three main phases associated with the preparation of the 
indicators of educational disadvantages the development of the indicatorSj 
the investigation of indicator characteristics, and the investigation of 
the 'meaning' of the indicators, These three phases have been summarized 
in the following paragraphs* 1 

The Development of the indicators 

In order to guide decisions concerning the development of the indicators, 
a list of items describing important properties of the indicators was 
prepared* unit of analysis * nature of the criterion variables, statistical 
constraints* stability* parsimony, and face validity* Following an exam- 
ination of these properties a three-stage strategy was designed which aimed 
to optimize satisfaction among the often competing requirements of the list 
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of important |wi«|ierl ics of indicators. The three-stage strategy involved 
the preparation of 22 groups of census percentage variables which described 
various aspects of the school neighbourhood environment, the use of step- 
wise regression analysis within each of these groups to form 22 linear 
composites of census percentage variables which were optimally correlated 
with the criterion variable, the use of stepwise regression and principal 
components analysis to combine the linear composites into the indicators, 
and the validation of the final set of indicators. The results of these 
analyses have been reported in Chapter 7, 
Th e In vest ijiat joi» of Indicator Ch ara etcristics 

Following the development of the indicators, they were employed in a range 
of analyses which were designed to provide a detailed investigation of their 
properties. These analyses examined the nature of the dimensions assessed 
hv the indicators, the predictive power of the indi ith respect to 

school mean achievement scores and school behaviour .mate, the precision 
with which the indicators could be used for resource allocation, the 
properties of school mean achievement scores following residualization by 
the indicators, and the theoretical and 'cross-age 1 stability of the 
indicators. From the results of these analyses a 'preferred 1 indicator 
was selected for each age level. The results of these analyses have been 
reported in Chapter 8, 

The investigation of the 'Meaning' of the Indicators 

The development of the indicators was primarily guided by the aim to 
optimise the predictive power of the indicator scores with respect t© school 
mean achievement scores on the tests of Word Knowledge, The 'preferred 1 
indicator was therefore based on a wide range of school neighbourhood 
characteristics. This wide spectrum made it difficult, if not impossible, 
to readily deduce a descriptive name for this indicator by inspection of 
its census percentage variable correlates. In order to clarify the nature 
of the social dimension assessed by the preferred indicator, the 'meaning' 
* of the ^idieator Was investigated with respect to the Shevky-Bell model of 
residential differentiation. This model enabled a description of the 
indicator to be made in a more parsimonious and more readily interpretable 
form based on three dimensions of school neighbourhood residential differ- 
entiation. The results of these analyses have been described in detail in 
Chapters 0 and 10, 
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CHAPTER 5 



THE DESIGN OF THE SAMPLES 



Introduction 



The target populations' in this study were designed for a national study 

of the educational achievements of Australian students in the areas of 

i 

reading, writing land numeration. Prior to the execution of this study 
there had been no; other investigations at the national level which had 
attempted to examine the educational performance of students in both 
primary and secondary schools: Previous studies (Radford (1950), Reeves 
(1968), Rosier (1973))* had undertaken large-scale evaluations of 
Australian education - however, these studies did not attempt to cover 
both level h of schooling, nor did they consider a coverage of all 
Australian States and Territories* ; 

An initial decision wa^ concerned with whether to focus the target 
population definitions on age. or grade samples a Sampling by grade was 
known to be considerably less complex than sampling by age since grade 
statistics for Australian schools were more readily available, and also 
the conduct of studies based on intact classes would subject the part- 
icipating schools to less disruption during the data gathering operations* 
jlowever, because of the_ different school entry and grade promotion ; 
poTicies^ in different parts of Australia and in different school systems, 
it was therefore considered that = grada^based information would not be 
meaningful when attempting to obtain an overall picture of the performance 
of Australian students, 

It was further considered important that the use of sampling by age- 
should represent, as accurately as possible, the total age cohort involved 
in normal schooling. At the primary school level this was not a major 
problem because the whole of primary schooling in_ Australia^ falls within 
the years of compulsory schooling, However, at the secondary school level 
the age cohort was selected to be as close as, possible to the end of the 
period of compulsory schooling, - 1 

The selection of the age cohort at the primary school level was 
governed by the researchers' aim to focus on an age group in primary 
schooling which could be expected to* have at least mastered the funda- 
mental skills which .were to be assessed. The selection of this age cohort 
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uUo had to take UiM i—i:^ f re 4 -d o r a-t -k> fr-^tet4— 4h<? resting environment for the 
stuUv would be cent red around group' test ing sessions rathe?' than Individ- 
ual i -ed testing. The type of testing environment which was to ho used 
thorotore precluded the use of ago cohorts in the early years of primary 
schoo I ing — 

The age levels selected t o r s t u dy we re t 

Ag e 10 i 00 to lQj ll years, ; during the middle primary school 
period where the basic skills of literacy and numeracy , which 
influence to a major. extent all further learning, should have 

— *" ===== fro e n accpiiredj and _ ; 

Age 14: 00 to 14 \\ 1 years, during the middle secondary school 
period at a lever immedTately prior to the end of the period 
of compulsory schooling, where all students were still at 
school, (Keeves and Bourko, 1976tl3) 

The above tw = - descriptions represented the desired target population 
definition* .for the study. Some further refinement of these descriptions 
was undertaken to obtain the defined target population definitions* 
These defined target population definitions' were then later used to 
assemble the sampling frames for the; study* 

The excluded populations for the study were those students who were 
attending special schools which operated independently of the norma 1 
schooling system in each State and Territory* These schools were generally 
^designed to cater for the deaf, blind and educationally sub-normal, A 

'detailed description of the excluded population has been presented by 

\ ■■ 

fceeves (1977) . At the 10-year-old level 'the excluded population 
\ . - " " - ' / 

represented 1*1 per cent of the desired target population and at the. . 14- 
i - ,- ( * 

yo^ar-oid level the excluded population represented 1*0 per cent of "the 

desired target population* 

It was important to remember that the defined target populations 

weri? concerned with those students attending normal schools* Therefore, 

' _ _ ■ / 

those students who attended special classes which were held within normal 

schools were, also included in the defined target population. - 

\ The Sampling -Frame , / 

After having decided upon— specific definitions of the defined target 
populations, the next stage in the sample design procedure was to construct 
sampling frames for each of the populations, The first step was to 
compile a list of primary and secondary schools for each school system 
together with the numbers of 10-year-old and ' 14-year-oid students in each 
school on 1 August 1974* j ■ ■ 




The si.' lists were then stratified within each State and Territory 
according to the following nine classifications* 

1 Government metropolitan schools 

2 Government non-metropol itan composite primary/secondary schools 

3 Government non-metropolitan schools , . 

4 Catholic Systemic metropolitan schools 

5 Catholic Systemic non-metropol itan "schools 

6 Independent Catholic metropolitan schools 

7 Independent Non -Catholic metropolitan schools 
R Independent Catholic non-metropolitan schools 

9 Independent Non-Catholic non-metropolitan schools 

Within each stratum of the.two sampling frames the schools were 
listed in postcode order. The use of this extra element of implicit 
stratification ensured that when a systematic sampling technique was used 
across each stratum, schools which were geographically adjacent would not 
be drawn, The resulting samples would therefore represent a balanced 
geographic coverage of each stratum - without disturbing the basic 
probabilities of school and student selection, 



The reference date for the sampling frame was set at 1 August 1974 
since this was the date of the mbst recent schodl census. The reference 
date for identifying students within schools for testing purposes was 
defined to be I October 1975, since testing was planned to take place 
during the week of 6-10 October 1975, This discrepancy in dates meant 
that the estimates of the numbbrs of students in each school falling 
within the target population definitions were* approximately a year lout 



of date , 



In a stud»>L..of-thxs magnitude it would never be possible to obtain 



exact figures for each school in the country for the precise time of 
testing. The decision was therefore taken to employ 'measure of size' 
figures (KLsh, 1965:222) as exact si^s . This assumption was made quite' - 
confidently because' it was known that large variations in cohort enrolment 
figures were unlikely to occur in the space of one year. Further, if' 
proportionately large (or small) enrolments occurred across all schools 
then this would in no way alter the basic probabilities of se-lection" for 
schools and students . " H 



The Sample Design 

The sample design dtj^this sndy followed the procedures employed in 
Australia during 197o"4or the IEA Science Project (Rosier and Williams, 
19^3), This s'ample design employed a two-stage stratified design, 
%cioct.in K schools at the first stage and then ^students from the selected 
school s * > 

' f The schools "were sampled with a probability proportional to the 
timber of students in each school within the target population. The 
selection of schools was. undertaken separately within each State and 
Territory, A sample, of 25 students from each selected school was *hen 
randomly drawn from the students within. the target population description, 

*". = The decision to sample clusters of 25 students from schools was _. 
undertaken to maximise the validity of. the data. It was reasoned that a 
grpup .of this -size cdutd be tested in one testing session in a single 
classroom. This would minimize the possibility of the contamination of 
results when, for example, larger numbers of students tested in schools 
may have required testing sessions at different times or days. A further 
consideration, which was also aimed = at maximizing the validity of the 
results, was that the schools would be more co-operative in terms of the 
f - standardised conditions required for testing if the testing program was 

|i ------ - ^ 

not overly disruptive of the -laily school program, ■, 

The level of sampling precision followed the constraints employed in 
the IEA Science* Project t that the standard error of a mean for each State 
should be approximately six per, cent of a student standard deviation, , f 

If we were to select a simple random "s_amp_le of n* students from a 
State then the standard error of the sample mean could be written as 
(iloss , 1975:113) ; - * 



SE(x) 



J i N "*n* J 



where ? SE (%) is the standard error of the sample mean , 

N is the population size, 

n* is the si so of the simple random sample , 

and S is the standard deviation of student scores, ■ * 

> When N is large compared to n* (as it is in this study for the State 
samples)", we may' write: , ■ : 



-= - - N = n* 

since the term - N tends to unity. 

If we require the value of 5E fx* ) to. bo approximately six per cent 
of the standard deviation of student scores, then we have : 
bS = S 

100 /n* ? — - I , 

\ * 

or, ». t 1 »», ? 

= 277.8 

- _ That is» in order to satisfy the error requirement a simple random 



sample of at least 278 students was required. 

Unfortunately, the use of a simple random sample of this size may 
have required testing in as many as 278 schools in each State, This would 
have been beyond the resources of the study, " 

Further, since some ' ^tween-schools analyses were planned for the 
study, such a sample design would not have provided sufficiently stable 
estimates of school mean scores, 

The dejcTsrr&n to sample clusters of 25 students per selected school 
which was described above required an appropriate decision concerning 
the number of schools which must be selected at the first stage in order 
to obtain an equivalent degree of precision as for a simple random sample 
of 276 students. Recent research (Boss, 1976) has shown that an equivalent 
degree* precision cannot simply be obtained by samp ling ~~ « _J l _ sehoo 1 s 
followed by the selectidh of 25 students per school, / 

Instead, we must appeal to the 'planning equation ? described by Ross 
(1978: 159) which presents a functional relationship, between the. number of 
schools required in a two-stage sample design and the size of the simple 
random sample which has equivalent precision: 

" ~m = ==r 0 ¥ (n - 1) roh] \ — . 

whore m - the number of schools— in the two-stage sample , * 

- - --^ *~ the number of students to be selected from each of the 

; M schools [23 in this study) , . : ... 

and roh ^ the sample estimate of the population coefficient of 

intraclass correlation, (See Appendix 



' ' . \ 

.' ■ • \ 

lii pmiuus m u.l it"- Illu^'ii, liU.7; IVaUr, 1975) it was shown that an 
c^tfmutc of rah = 0,1 a' suitable figure tor Australian secondary 

-schools. Nc Vimllar evidence was available for im! estimate of roh_toj)e 
made fur \u ' Alian primary schools and consequently the sap value for 
this populat ion' was assumed, - \ 



we obtain 



. \ 

substitutim; i. - i»* « and roh * 0 1 into tho V»bove equation 



\ 



V s fl * (25 - n o.O 



J7S x_ \^ 



That la, we would require at least 3S schools at the first stage of 
sampling in order to satisfy the error constraint that the standard* error 
of the- mean should.be no more than six per cent of the standard deviation 
yf student scores* - . \ 

- For the purposes of this study it was decided that a sample of 40 

schools per State would provide a suitable degree of precision-. \ 

In the Australian Capital Territory and the Northern Territory a; 
similar sampling procedure was followed except that only 20 schools were 
selected at the first stage of sampling. The errors for the estimates! of 
means were expected to bo slightly higher than for the' States (approximately 
ten per cent ,(Keeves and BouYke, 1976:173)= However, in the overall i 
Austral Ian estimates these increases would be expected to have only a ■ 
^mail uf feet due to the weighting adjustments which were used to correct 
for the disproportionate sampling from the States and Territories , J 

'• • i 

For the Australia overall estimates the samples were designed to I 

obtai.iya maximum of 7000 students at each age level" With samples of thjis 
size it was expected that ..the errors of estimates for means would be 
between three per cent and six per cent of the standard deviation of 
student "scores (Keeves and Bourke, 1976*1^), \ 

T he Sampling of Students within Schools ■* j 

The sample design required the selection at random of 25 students from 1 
each selected schoo 1 In order to achieve this, each selected school was 
asked to submit a list of all students falling within the defined target j 
population. These lists were checked to ensure that they contained no ; 
' students whose date of birth placed them outside the defined target 
populat ion . • ._ t J A 



When the '.thonl lists had been checked, 50 students - 25 students 
for the sample and five reserves - were selected using 1 ' the following 
procedures : ' 

1 Choose ail students with birth dates on the 10th day of any valid 
month (within the defined age hands for the 10->*ear-old and 14 = 
year-old population) s 

2 Choose all students horn on the 11th, 12th etc, days of any month 
* until the 25 students required have been selected, 

J If there are more than the required number of students with birthdays 
on the ilth, 12th etc, day of the month than are needed to yield a 
group of 25 students, choose "..the- students required to complete the 
sample of size 25 at random from those students with birthdays on 
the terminal day. \^ 

4 Pi ve . additional students were chosen by continuing to apply the above 
method. Those students were the reserves. The reserve students were 
used to replace students who had been selected for the study but 
were missing on the day of testing for reasons such as: transfer 
to other sehools between the selection and testing dates, illness 
on the day of testing, etc. 

The Designed and Achieved Samples 

From the previous discussion it was demonstrated that, in order to obtain 
the required levels of sampling precision, it would be necessary to select 
samples of 40 schools followed by the selection of 25 students per school 
in each State, and to select 20 schools followed by the selection of 25 
students per school in each Territory, 

If it was possible to have full participation of all selected schools 
and to obtain complete data, for all selected students then we would refer 
to these samples as the 'designed samj les 1 , In practice , for studies of 
this magnitude, there has often been some loss of data due to reasons such 
as: the refusal of some selected schools to participate # and the absence 
of some selected students on the day of testing, The resulting body of 
data which eventually wa r available for analysis was referred to as the 
1 achieved samples', - ^ 

In Table 5,1 the information summarising the execution of th^ sample 
design, for each State or Territory, and for each age gr^up has been 
presented . 

So 
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Tab 1 1? 3,1 Stipiiry of Sump It* Designs for Australian lO-Year-Ohl and M-Ycar-Qld Samples 
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Ihe ' iv.spnii-w r.iU". for u.j^h of the States were highly satisfactory, 
generally beint< in excess of *U) per cent. However, lor en eh of the 
Territories, the response rates were below this desired value. In part- 
icular, there wen 1 cons iclcrable data losses in the Northern Territory - 
especially at the I-l-yeur-olil level* This low response rate in the 
Northern Territory was considered to he associated with problems of remote- 
ness and postal iIUTUmiJ t ics, and because of the disruption that had 
occurred to the educational system of the Northern Territory due to the 
cyclone in late 197-1, " 

* s Jr t ghtiiii; the Sn mpJ e lies i fin 

The sample designs in this study employed disproportionate sample allocation 
anions the expl I c i t strata . This technique was employed in order to permit 
the calculation of State/Territory estimates with approximately equal 
sampling error, in order to compensate for this disproportionate alloc- 
at ion it was necessary to calculate weighting factors, both at the between - 
students and betwetm-schoo l s level of analysis, before estimates of 
Aust rn I i a -overa 1 1 parameters could he made . 

The weight i tig factors "had to take into account the possibility of data 
loss due to non- response from both students and schools. This required 
that certain assumptions be made about the nature of the non-response. 
These assumptions, which have -been described in detail in Appendix G, may 
be summari zed as: 

1 The sampling frames prepared for the study were accurate 
representations of the defined target population, 

2 The achieved numbers of schools and students within schools for 
each stratum were planned constants, That is, any data loss from 
schools or students could be considered to be 'missing at random*, 

Since the sampling frames had been prepared from official school 
census in format ion »and since (with the exception of the Northern Territory) *■ 
the response rates had been extremely high for a study of this kind, it was 
considered that these two key assumptions would form an acceptable basis 
for the use of weighting factors to adjust for non- response . The low 
response rate in the Northern Territory did not present a challenge to 
these assumptions because it was known that the. Northern Territory results 
would have little influence on Australia overall estimates after adjustment 
for the disproportionate allocation of the sample between strata had been 
made/ , g? 
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In Appt'iuiit G •< i hooiviii'iil discussion has been presented fe^hich 

describes the prtpa^CL . t ion of the weight ing factors, 

At ^tlie__l»«iKeC5*s -tudents level of analysis the weighting factor (wf) 
for student i in u'ho ^ o 1 j of stratum k was: 

\\ x n' 



wf t students) 



x N 



where B ,= t»t a i number of students in stratum k, 
n f - aeh^ieved total sample size (students), 

u ! = jiclisieved total number of schools selected frortes stratum k } 
i; 1 5 athsieved JutaJLaumbor of students selected ,f rcr^m school j, 
and N - tot=al number of students in the population. 

At the hetwc4M^s^chooi level of analysis the- weighting faetes»r for 
school j in strattiifl t=i was. 

, > » xl^a» 
wi (schools) § k- 



wherein* s itschieveil number of schools in the total samp^^Ie^ 
k 

The use of thi'Sc— weighting factors for the between-student and between- 
school analyses had fche following effects: 

1 The wulgh iesd number of students per school jtfithin_e ach ^__s^atujn 
was a constant. For example, in Victoria at the 10=yeaT-olE§,d level 
the weightud tUln=iber of students per school was 43,5 for alES, schools in 
Victor ; ;i . Tna ES"igures for other States/Territories at bothr~i age levels 
have been ifsto gg in the second column of Tablets,?. 

The equal it^y of the weighted number of students per se^^hool within 
strata occurred because, whore datp. loss occurred for a partrn^i cular 
student within particular school, the loss of data for *lu*„at* 
student wiiMO^r^ en sated for by increasing the weight for th^e other 
students in Hint — = school, It is important to note that tbis^s effect was 
produced by havi - nn unequal weighting factors for schools wSithin each 
stratum, For Ox^compiOj in Victoria at the 10-year-old lov^^a the response 
rates for schtfoi.._ s of 25> 2d i 23, and 22 were associated wyi^^h weighting 

factors of 1.74, l,81pli89, and 1 ,'98 respectively, The f^Sgures for 

other "States Territories at both age levels have been ISSsted in 
Table C.,2 of App=*endix G. 
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Tabltf li^J^ightnliih^H of Student;; and Schools, and the Nufflbfers of Students and Schools Which 

Would jlaye j k-cu gmi for Proportionate Sarapling 



Krighteil Staples Proportionate Distribution of Sa mples 



__ Student level School Level Student Level ~~ School Level 
Students Students Students Students 

per School . ' per School 



'Nit jjfcr i th Mm 


1739,/ 


43.5 


i Q 


5,103,3 

1739.8 






QtioeilOaiid 


PBS J 
(tUO.l 


IW 

15.0 


73.6 
41.7 
25.6 


088,2 
601.2 


45.5 

25 § 

15,0 ' 


73. S 
41.9 
25,5 




549.5 


13,? 


23.2 


549,0 


13.7 


23,3 


TaswttSa 


205 ,5 


5,3 


9.0 


"•. 207.6 . 


3,3 


S.8 


fliistrtSXii Capitol! Terr 


iteiy :l 94. S 


< 5.2 


4.0 


'94.3 


s ?. 


4.0 


HQrtl«=n Tefrit^iw 


51.S 


3.2 


: 2.1 


50.6 


3.2 ' 


.2,1 


lot al 


64 16 J 


^^.^^^ _ 


271.9 


6416,0 




272,0 


•*!ew *y<ji nli NO In 




y & 


Ql .0 




j 

W fV 


2/ ,0 


VUtfrtsa.. 


1627,5 




".69,0 


1626,0 


41.7 ■ 


68.9 


Queen s & and 


952.6 


25.2 


" 39.6 


931. 0 


25.2 


39. 4\ 


South r^mtralia 


590.1 


15,9 fc 


. 25.2 


590. 1 


15.9 


25.0 \ 


fait* in fatniii 


SOT. 4 


134 


21,5 


509.2 


13.1 


21.6 \ 




204.9 


5.2 


8,6 


202.5 


5.2 


8.6 


ftstrtdu hpitUL Terri 


.tor,' 81.5 


4.1 


3.4 


80.8 


4,8 


3,4 v 




51.0 


5,1 " 


1.3 ' 


31.2 


' 3,1 


1.3 


Total 


6046.8 




256.3 


6045.0 




' 256,0 


iERJCa Httstlredde; 


itription of th 


e ealculat.iosn 'of weightii 


ni. fiction has bem presentid in Appendix G. 
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2 Th e weight ed number of students for each stratum was equal (except 
for rounding error) to the number of students which__would have been 
selected from each stratum if a true proportionate sample design, had 
been used. For example, a proportionate allocation of the total 
achieved sample of 6416 10 ^ear-old students would have resulted in 

the selection of 1740 (actually 1 739 . 8") students from Victoria, The 
weighted number of students tn Victoria at this age level was 1739,7 
which was equal (except for rounding error) to the proportionate 
allocation sample size. The weighted numbers of students for each 
State/Territory and the proportionate allocation numbers have been 
presented in columns one and four of Table 5 .2 , 

In columns two and five of Table 5,2 the weighted numbers of 
students per school and the numbers per school which would have been 
selected by using proportionate sampling have been presented, At 
both age levels these sets of figures wore equals for each State/ 
Territory* ' • 

3 The weighted number of schools for each stratum was equal (except 
for rounding error) to the number of schools which would have been 
selected from each stratum if a true proportionate sample design had 
been used, For example, a proportionate allocation of the total 
achieved sample of 272 primary schools would have resulted in the 
selection of 74 (actually 73,8} schools from Victoria, The weighted 
number of schools in Victoria at this age level was 73,6 which was 
equal (except for rounding error) to the proportionate allocation 
sample size. The weighted numbers of schools for each State/Territory 
and the proportionate a! location numbers have been listed in columns 
three and six of Table 5.2. The weighting factors for the between- 
school analyses have been listed in Table G.3 of Appendix G , 

'. 

The Estimation of Sampling Error 

The sample designs used in this study were not based on the well-known model 
of 'simple random samp 1 ing 1 # Instead they incorporated the complexities of 
st rati f icat ion , the selection of students in clusters, and also the use of 
unequal probabilities of selection which required the use of weighting in 
order to minimize bias in the sample estimates. When *hese "complexities 
h p ve been introduced into a sample design it is not possible to use estab- 
lished . forifiulae. The computational formulae required for estimating the 
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standard errurs oi complex statistics (such us correlation coefficients) 
from complex sample designs are either enormously complicated or 4 
ultimately, they prove resistant t© mathematical analysis (Frankel, 1971). 

In this, study the technique of 1 Jackknifing ? (Quenouille, 1956 1 
Tukey, 1958) was used to calculate sampling errors, A review of this 
techn i.que- has been presented in Appendix G, The calculations required 
to apply the Jackknife have been described in Appendix C and Tables G4 
to G15. 

From the Jackknife calculations two statistics were obtained for means 
and correlations; the average of the square root of the * design effect 1 
and the ? effective sample size* (Kish, 1965:162). These statistics have 
^^tTTfen presented for the botween-studont and between-school levels of analysis 

in Table 5,3, These statistics were not calculated for correlation _ 

coefficients at the hetween-student level of analysis because no correlat- 
ional analyses were carried out by using students as the units of analysis, 

A detailed description of the 'design effect* and the 'effective 
sample size 1 has been given in Appendix G, . 

The values of the average of the square root of the design effect, 
average /De f f , may be used to estimate sampling errors in the .following 
fashion (Ross, 1979bU39): 



Where v = the statistic being examined, 

se(v^) - the standard error of the statistic for the complex , 
sample design , 

and se l v ^ rs ) ^ the standard error of the statistic under the assumption 
of simple random sampling. 

The values of th^ effective sample size described the size of a -simple 
random sample which would give the same sampling error for the statistic 
as for the complex design (Ross, 1978:138), 

Summary 

In this chapter the sample designs which were used to gather data from 
Australian students and schools have been described, At the 10-year-old 
level the sample consisted of 6416 students in 272 schools * and at the 
14-year-old level the sample consisted of 6045 students in 256 schools* 
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Libit- \ a i Hi'-i ii i An-ranc » i>o t'f and t he li f feet Sample Size 

tor Means and I'u rre 1 at ion a 



Stat 1st i c 




Level 


of Analysis 




Betw eo n 
10 


-Student 
14 


Between 
10 


-School 
14 


Average = * Pe f f * 










Means 


2.04 


2. 15 


1 ,04 


1 . 19 


Correlations 


a 


a 


0,76 


0,89 


1: f to e t i v e S amp I e Size Values 










Means 


1542 


1308 


251 


■■ 181 


Correlations 


o 


a 


471 


523 


Tor :i 1 Sample S i ZC 


b4 ! 6 


6045 


272 


256 



Note: a Values of average s^e f f and the effective sample size were 
not calculated for the between -student level of analyses 
be catls i' no correlational analyses were conducted by using 
students as the unit of analysis, 

A weighting scheme was devised in order to simultaneously adjust for 
CI) disproportionate sampling among the explicit strata of the sampling 
frame and (2) loss of student data within schools selected into the sample 
This weighting scheme ensured that the weighted number of students per 
school was constant within each stratunij and that the weighted number of . 
students and schools across strata was equivalent to a proportionate 
allocation of the sample. ■ - * • 

The Jackknife technique was used to calculate the sampling errors , 
of means and correlation coefficients for the between-school level of 
analysis, and for means at the between-student level of analysis, At the 
between-school level * the 'design effects* for means were close to unity 
whereas for correlations they were slightly less than un i ty , At the 

' 5 

between-studerit level the design effects for means were substantially 
greater than unity, ' 
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THE STAGES OF DATA PREPARATION . / 

Introduction 

The data employed in this study were derived from two sources i data 
gathered for the Australian Council for Educational Research (ACER) study 
concerning the literacy and numeracy skills of Australian 10-year-olds 
and Ul'Vear-olds (Keeves and Bourke , 19763* and data gathered for the 1971 
Australian Census of Population and Housing (CBCS, 1971) . The ACER study, 
known as the Australian Studies in School Performance (ASSP) project, 
cirrieJ out its data collection during October 1975, Data were collected 
for a national sample of 10-year-olds in 272 schools t and a national sample 
of I -I -year-old* in 256 schools* As part of the terting program forxthis 
study, each student was required to provide a full home "address , With x 
the assistance of maps, street and telephone directories and the official, 
Australian census maps t theistr addresses were transformed into Census 
Collector's District numbers. The Collector's District numbers were then 
used to link the computer stored ASSP data with the 197T Australian 'census 
data. 

In the following discussion the preparation of the computer-stored 
data files which were appropriate for the between-student level of analysis 
has been described -An detail. These data files were subsequently aggregated 
to obtain data files appropriate for the between-school level of analysis* 

' The Australian Studies in School Perfor ma nce (ASSP)' Project Data 

The data gathered for the ASSP" project '"focus sed on Australian _1 6 -year -old 
and 14-vear-old students. The students provided in format ioiH^S^mTjans of 

• - 7 - 

specially designed mastery tests in readings writing and ? numeration * They 
also completed a tost of word knowledge and a quest iontTaTre^ which was * 
concCi with detailed information about the students and their home, 
backgrounds Further information was gathered from teachers describing 
the incidence of any physical s physiological and behavioural handicaps 
which the students may have-exh ibi ted . \^ 

The Reading s Writinji and Numeration Tests 

The procedures involved in the development "of the ASSP tests of reading, 
writing and numeration^ have been described in detail by Keeves and Bourke 
(1976./. In brief, the development of these tests consisted of four separate 
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stages, I \ r>t . thi- I'i'jt'i't \ vv< of testing in each area were specified, 
Secondly, a list of tusks and ;suht asks regarded as essential learning in 
each area was prepared* Thirdly » items were constructed which were 
consistent with the stated objectives and which assessed performance on 
Che defined subtasks* HinallVj items were selected according to their 
validity in assessing student performance on the suhtasks, and according 
to an appropriate difficulty .-level, for the two age groups, ^ 

All students in the study were required to complete the tests of 
reading and numeration, However* the Writing Test was designed, as three 

i 

different forms in order to completely cover the specified objectives 
and was used as a rotated forms test. Three forms were^randomly rotated 
among the members of the samples and consequently only a third of the 
sample at each age level completed the same form of the test, The 
resultant reduction in the sample size which occurred for each 4 form of 
the Writing Test led to a greatly reduced level of sampling accuracy (Ross, 
iy?eV) and therefore performance levels on these writing tests were not 
inc laded in 3 this study* 

The Reading Tests at each ago level covered four areas of ability: 
to apply word attack sk i 1 1 s != _ta use convent ions employed in written 
language as an aid to understarrding, to comprehend what is^readj and using 
a variety of approaches to obtain information (ACERr-4,976a3 * The test for 
ifUyear-olds (referred to as test 1QR) consisted of 29 items and the test 
for 14-year-olds (referred to as test 14R) consisted of 33 items* The, 
time limit allowed for completion of the tests was 30 minutes at both age 
levels. ■ 

The Numeration r ests at each age level were .initially included to 
cover four main areas of ability* to recall definitions and notations, 
to manipulate and calculate rapidly and accurately, to interpret s>^nbolie 
data, and to apply mathematical concepts, Th&se four areas were later 
collapsed into two broad areas of -ability: recal ^/manipulation $ and inter-, 
protat ion/aepl ication (ACER/ 1976b)* "he tests for 10-year-olds (referred 
to as testjj^J&V and 14-year-olds (referred to as test 14N) each consisted 
of 53 itemS^^llie time limit, allowed for the completion of the' tests was 
30 minutqs* at both age levels. 



The Word Know ledge^.Xes,t _ . 

4 he Word Knowledge Test for each level consisted of 40 .word-pairs . The- 
students Kere required to choose whether the words in each pair h€d similar 
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or opposite bhmii i iijjs * |infh« of these tests were developed by R,L^ Thorndike 
for studies carried out by the International Association for Hdueat ional^ 
Achievement . Thorn dike (1973) has indicated* that these tests^were ■ 
designed as brief test's of verbal ability rather than as instruments for 
tHe measurement of reading comprehension . 

Tho_ A t Ujjent J jugst i onna i re - ^ * 

This, questionnaire was designed to obtain general infojnuit ion about the * 
Xt'trcteTit and also some information about the student's home environment. 
The quest ions concerned with general information included questions about 
the "student * s' home address s age J sex. the number of schools attended and 
the number of years the student had lived in Australia, The questions 
concerned with- the student -s home environment included questions^Jihout the 1 
ethnic hack^rofind of members of the student I s family* languages spoken in 
th^? hc/^e, family size, and whether newspapers ^ we re read in the home, 

Th e T V a c h e r j j ue s t i o n n a t r e 

A tea.ch.er-- who knew each, student well was asked to complete a questionnaire 

'which described the incidence of any _physie=fii , physiological and behavJjoural 
handicaps which the student may have exhibited » = . - 

% The - ques t i ons associated with physical, and physiological handicaps 
included questions covering' vrftal impairment, hearing impairment, speech 
impairments dexterity, lethargy ¥ hyperactivity and health condition (for 
example , diabetic, epdleptifc, asthmatic). The questions associated with 
behavioural, handicaps included questions coveVing attention, seeking, 
inability tt> co-operate wlthpeorSp seXf * i so lat ion t timidityi and marked** - 
re i ec t i on " by other students, ** ~ 



\ - The Merging of the Data F iles 

.[luring the testing program carried out for the ASSP project, the sample 
members wcv 
ass i stance 
Austral i an 



required to provide their complete" home addresses, With the 
bf maps, street and telephone^ directories andtphe official 
census mapSiQjhose addresses were coded into fpl l ector ' s 



DT strict (j*H) ) numb e r s , 



A set 
student * s i 



the' ASSP da 



if punched cards was then prepared. These cards (Contained each 

lentif icat ion number from the ASSP study ? and* /the appropriate CD 
I * * | * f - : " ' • 

number* associated with the student's homo address. A cOmputer-stored data 

Tile was constructed from these 1 cards and t!- jn this file was merged with , j 

* t 7 

:a file, , 



Ihi • i i N- w.i-- t htMi sorted on the CD numbers in preparation for morning 
*ith the census data, I his sorting p roc ess was carried out on the? combined 
I0->t'"ar-old and 14 -year-old ASSP data file?.' — _ . 

She comb Luav ion of the originally separate ASSP data files w\ts under" 
tuk.;ii in order* to minimize the number of merge runs which would he required, 
That is, a sin^k Aus ixajja-ovc ra 11 AS SI' data f i I* containing all data from 
both age groups wa? employed Ui the merging operation. This was not 
possible for the census data file because the magnitude of an Australia* 
overall census data -file would have led to difficulties for .individual 



computer runs with respect to the large amount of data storage space and 

c » mpu t e r time w h i c h wo u 1 d he re mi i red * Since t he- cornpu ting work f o r this 

*tudv had to fit- in with- the daily operations 'of- a commercial computing 

installation, it - was necessary to conduct the computer merging separately 

fori <?;/eh State and Territory'. * 
/ - 

^.4. 'I he Census Data 

• c4 : • ' ~~ • 

Ihe census data employed in this study was derived from the 1971 Australian 
Census of Population and Housing (CBCS, 1971), The data from this census 
"was gathered about four years prior to the ASS p data, In ^Austral 1 a „ a 
census is now normally conducted every f ivo ■ years *and therefore the 1976 
Ceirsiis of Population and Housing CABS* 1976) would have provided census 
data which was nearer in time to the ASSP data collection, Tjie decision 
to employ M)?l census data rather than" '19 76 census data was based on the / 
following reasons: - ^ . . 

~\ \z the 4 time, of the eommencomcnt of data preparation for this study, 
complete 1970 census data for all Australian States and Territories 
were noT "available. This constraint, in addition to the uncertainty 
associated with the date when complete 1976 data would become avail- 
able, i \ m\ tod. th e choice of 7 census data to the 1971 Census,- 

2 ■■ Due to unusual economic circumstances in Australia at- the time of 

the '19-70 eerjsus it was decided by the Australian Government that only 

f^xJ t^ , ii) ihiv t « ir^ns schedules would' be processed from private 

towellings in all ^States' atid the Australian Capital Territory, This 
^ ample was Selected at the CD revel by randomly selecting either the 
first or second private dwelling in each CD and then ''systematically 
• taking every second private dwelling after that. The use of a sample 
. of private dwellings in the 1976 consul rather than\thc usual complete 
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coverage resulted in the introduction of sampling errors into the 
census data. While these errors may have been small for estimates 
, "derived at the national level s the possibility of largo errors for 
rarely occurring population characteristics at the CD level was 
greatly increased. Since this study was concerned with the linkage 
of students 1 characteristics to the characteristics of their commun- 
ities it was. decided that these sampling errors might lead to the 
overlooking of important relationships between student character- 
istics and certain rarely occurring population characteristics, 

/ . ' - 

3 The preparation of census data by the Australian Bureau of Statistics 
» - 

required a great deal of time* The time gap between the data collect- 
ion and the release of complete and detailed national data for general 
use may often take from one to two * years * Therefore it was unrealistic 
to expect that' the use of census data to make large-scale adminis- s 
trative decisions about education could be undertaken prior to periods 
of up to two ^years following the actual collection of the data. ' 
Inevitably, because of this time lapse, questions may be raised about 
the suitability of using 'old 1 data to make 'current 1 decisions. 

It was considered important in this study to use ^, the census data . 
in a realistic fashion and consequently it was decided to choose census 
data which provided the largest possible time gap between data collect-* 
ions* Any generalisations which could be made concerning the inter- 
relations between the two sets of data would therefore be strengthened 
because after *i»ur years the census data was in its most 'out-of-date ' , 
condition . ' ' . *• 

The Preparation of the Census Data 

The 1971 census data was distributed by the Australian Bureau of 3 Statistics 
in a form which was not appropriate for immediate use" in the' file prepar- 
ation stage of the study* A major re-organization of the original census 
data was required in the following areas: 

1 .Por this study only census information at the lowest level of aggre- «. 
gation* the Collector's District j was required* However, the census 
data tapes distributed by the Australian Bureau of Statistics contained 
a range of different types of data records which represented four 
different levels of data aggregation: CD (Collector's District) 
records containing data for individual^ CD's; LGA Part (Local Government 
Area Part) records with data totalled over all CD's in each LGA Part; 
LGA records with data totalled over the LGA Parts comprising the LGA; 



and a State total record containing data totalled over air CD's forming 
the State or Territory, As a first step i*n preparing the census data 
files it was necessary to rewrite the census data tapes to ensure that 
they contained only CD records. 

2 ' Tlift original census data tapes were produced on computers with tech- 

nical specifications. which differed from the computer equipment which 
was to be used for the study. It was therefore necessary to rewrite' 
the tapes in a suitable technical format. 

3 The OSIRIS software package (developed at the .Institute for Social 
• Research, University of Michigan) which was to be used in the data 

management phase of the study led to a further constraint on the re- 
writing of the census tapes , The version of the OSIRIS software 
package which was available for the study would only accept data 
records which were less than or equal to 3*600 characters in length 
(ISR, 1973:171)* After some investigation of the available CD inform- 
ation it was possible to reduce the original CD records from 1,068 
count variables to 710 count variables/ The reduced list of variables 
were reformatted so as to /require a field width of five characters per 
count variable. The resulting CD records were thereby reduced to 
3,S00 characters which satisfied the record length constraints of the 
software. The final list of census count variables used in this study 
"has been described in Table 6.1 . 

4 The CD records were- originaLly stored on tape in order of the CD * 
Serial Number, These serial numbers were assigned to CD' s beginning 
at 1 in New South Wales and ending at 21,536 in the Australian Capital 
Territory (CBCS, 1971 :2) . However, from the census maps , it was only 
possible to link each student's address with a CD identification 

. number based en the LGA code, LGA Part code, and CD number within LGA 
•'• p ar t code. Therefore a new CD identification number was required to * 
\ be constructed from these three elements before the merging operation 
could begin * i. ■ 

The three elements required to construct this merge number were: 
(a) LGA code i This was the major tabulation unit code used in the public- 
ation of census results, ' This code corresponded in all but a few cases 
to legal local government areas and ranged from 1 to 400 within each 
State, . * 
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Lyuh lis Luunt 


variaoiGs Derived from the jy/1 Census of 
Population and Housing 


^Blli* LI 2j 

Table 
Number 


Number of 
Variables 


Table Description 


0 


13 


Indicative information 


1 


2 


Total pop x sex 


2 


\ ■ 3 


Total dwell x status • 


4 


1 


Total usual residents (persons) 


5 


1 


Total born overseas* (persons) 


7 


70- 


Sex x Age (total pop) 


io 


12 


Sex x Marital status (total pop) 




6 


Sex x Marital status (labour force) 




40 


- Sex x Birth place (overseas born) / 


17 


18 


Sex x Period of residence (residents) 


18 


12 


Sex x Usual major activity (total pop) 


20 


18 


Sex x Qualifications (studying) 


21 


IS 


Sex x Qualifications (obtained) 


22 


44 


Sex x Religion (total pop) . 


24 


, 2S 


Sex x Highest level school (total pop) ■ 




16 


Sex x 1966 Residence (usual residents) 


26 


14 


Sex x Occupational statu* (total pop) 


27 


26 , 


Sex x Industry (employed) • " 


28. ■ 


146 


Sex^x Occupation (employed) y 


30 


10 


Household, class x (population, dwellings) 


. 31 


10 


Dwelling class x No, dwellings (occupied) 


32 . 


■ 3 


Dwelling class x, Population (occupied) 


33 


24 . 


-Dwelling class x -Inmates (occupied) 


34 


21 


Dwelling class x Rooms (occupied) 


35 * 


■ 21 ' 


Dwelling class X Bedrooms (occupied) 


37 


24 


Dwelling class x Date' built (occupied) 


38 


48 


Dwelling class x Kitchen/Bathroom (occupied) 


39 


, 18 


Dwelling class :c Facil/W (occupied) 


40 


^12 


Dwelling class X Sever (occupied) 


41 / 


15 


Dwelling class x No, vehicles (occupied) 


45 


12 


Dwelling class x Nature of occupancy 


4 , . 


Size of block x pop,, flats (flats) - > 



Total number 

of variables 710 } 



0 

Source-; \CBCS (1971) 



(b) LGA Part code; This was a physical partition of an LGA* such that 
each LGA Part contained about 10 .CD'S • This partition facili tated 

; the LGA Parts being supervised with roughly the same workload' per * 
' supervisor. This code could take values from 1 to 33 within LGA f j _ * 

£c) CD code : This code referred to the basic clement of the, census data 
collection. There are- 2 1 , 5 56 CD's in Australia, The CO code had 
values ranging^TfomN^ to 2-5 within LGA Parts . 

On the revised census data Files the LGA code was Stared in a five 
character width field* and the LGA Part and CD codes wore stored as 
a composite also in a five character width field. These two fields 
"were combined to form a single ten-digit merge number. It was not 
necessary to include a State code within the merge number because 
the merging process was carried out ^separately for each State.- Prior 
to the merging of data the census data, was sorted, separately by State 
and Territory on this ten -digit number, = ^ 

5 The census data tapes provided variables in the form of 1 count 1 data 
(for example, the number of 20-year-old males in the particular CD) * - 
Although many CD f s were designed to contain the same number of 
dwellings ( app ro x imat e 1 )(J^3QQ dwellings], they generally contained 
variable population 1 numbers. ■ Therefore i in orrfer to adjust for 
variations in population size, dwelling numbers, etc, between CD's, 
it was necessary to- create percentages from the count variables (for 
example, the percentage of the total population in the CD who were 
20-year-old males) . 

The Preparation of Census Percentage Variables . 

The census-derived variables used in this study were percentages which 
employed direct count variables as denominators, For example, when the ■ 
percentage variables which described the workforce characteristics of 
the male and female population were prepared, the denominators employed (} 
were the /total numbers of males and females who were participating in 
the workforce, , , 

, in th^ following discussion the calculation of the percentage variahl 
from thi data in the census tables listed in Table. 6.1 has been described . 
These percentage variables provided information covering ten main areas : 
workforce .characteristics, industry type , mar j tal status, religion, 
educational qualifications, nature of dwellings, ethnic composition, age 



distribution, general facilities , and living arrangements * A detai led 
listing of each of the 148 percentage variables which .wore prepared has 
been given in Tobies 11,1 to H .22 in Appendix .11. ' 

Workforce Characteristics *- . • .. 

The. workforce characteristics percentage variables were^derived from 
Census Tables 26 and 28 (CBCS „ 1971113)* These two tables described the 
occupational* status of the workforce and the type of occupation in which 
members of the workforce wore employed, ■ , 

1 Workforce C haracteristi cs » Occupational Status . The census table 
describing the occupational, status of the workforce, used the categories: 1 
emplo; cr, sel 7 f -employed, wage-earner and unemployed. This information 
was^ piosented separately for males and females. The denominators used to 
Calculate .the percentage variables were the total number of males in 

the workforce and the total number of females in the work force i In 
Table H.l the percentage variables .for the members of the workforce in- 
the four occupational status, groups have been listed separately for males 
and females. ' • 

2 Wo r k f o r c e_Ch ara c teri sties : Occ upa t ion a 1 Typ e ■ . The census table 
concerned with the occupational type of the workforce in terms of the 
nufnbers of employed males and females used 73 occupational categories 

. (CBCS , undated b) * These 73 categories were rocoded sepai'ately for males 
and females into the 12 broad groupings employed by 'the Australian Bureau 
of Statistics .(ABS, 1976:34) . The 12 percentage variables derived from 
the occupation groupings have been listed in Table H.2« The occupations 
were grouped into the headings professional, administrative/executive/ 
managerial ? clerical * sales, farming/ fishing/hunt ing, miners, transport/ 
communication , process/manual/labour, trade/bui Iding ? service/sport/ 
recreation , armed services, and, not adequately described. The denominators 
employed in the calculatidn of percentages fpr males/ females were the total 
number of males/females in occupation categories 1-75. . 

iindiVstjx JjjffiQ . - 

The industry type percentage variables were derived from Census Table 27 
(CBCS , 1971:13). This table described the type of industry in which the 
workforce Was employed. The cl^ssif ication of industries was based on a 
13 group classification scheme . .. The 1 3 percentage variables obtained 
from the classification of industries have been listed in Table H.3; 



This classification scheme allocated members of the workforce to industries 
which had similar productive activities: ■ agriculture (including Forestry 
and fishing), mining , manufacturing t etc. The denominator used to 
calculate the percentage variables was the total number of persons in 
occupation categories 1-75 for Census Table 28. 

Ma ratal status 

Tno marital status percentage variables were ■ derived from Census Table. 
(CBC3, 1971 : 9) . This table described the marital status of males and 
females who were ev^r married. The marital- status of the population ~ 
reported in terms of the number of persons who were married, separated' ; 
divorced or widowed, 4 The percentage variable's calculated from this cenK 
table have been listed in Table H,4, The denominators £or*males/femaIes? 
were the total number of ever married males/females who were^ 15 years tof 
age or older, ' • 

Religion 

The religion percentage variables were .derived from Census Table 22 (CBC5, 
1971:11). The original ABS classification of reiigiohs employed 22 m 
categories, This^ detailed list .was reclassified into six main groups: 
Atheist, Hebrew, Protestant, Church of England, Catholic, and Other Religion* 
This reclassif ication^attempted to sort the detailed list of religions in * 
the census data files into groups which were homogenieous with respect to 
the educational background of the adherents* , 

The information concerning the educational background of the adherents 

was based on data prepared by Mol (1971). In Table IKS, which was derived 

• . ■ — ' — " 

from Moi's data, the main Australian religious groups and the number of 1 
' ',. ' ' - p 

graduates per religion for each 1,000 mare adherents Tiave been listed. . 

The revised six-group classification is given in the final column of- the 

table --" .. , 

^Following the reclassification of religions, into six broad groups, the 
groups were converted into percentage variables according to the descriptions 
An Table II , 6. . The denominator usou to obtain these percentage variables 
was the total population. * 9 

^dugatiOTai Qualifications 

The educational qualifications percentage variables were derived from three 
separate census tables: Census Tables* 20, 21 and 24 (CBCS, 1971: 10, 12), 




These three tables described the total numbers of .persons in the population 
who had obtained, or who were studying For certain levels of qualifications 
and the levels of schooling which had been completed by the population. 

(a) Educational Qualifications.* Qualifications (Obtained and jt^idyjng) 

The census tables which examined the qualifications of the population were 
centred around educational qualifications which would be undertaken after 
leaving secondary school. There Were four Categories of qualification: 
trade C'r technician study , tertiary non -degree study., and two categories 
of degree study: bachelors and higher degree study.. The denominator used 
•to calculate the percentage variables was the total population who were 
15 years of Age or older. In Tables 11,7 and !L8 the percentage variables 
for persons who had obtained, or who were studying for, the stated level 
of qualifications have been listed. - ■ 

(b) Educational Qualifications i , Q ualific ations (Level of Schooling) " 

The census table coneerned^ with level of schooling presented the numbers 
of persons In the population who had completed levels of education which 
ranged from never having attended school to havipg -completed level 10 of 
schooling, In * this study two classifications were selected for examin- 
ation: never "having attended school , and having completed level 9 of 
schooling or higher (CBC5, undated a). The denominator used to calculate . 
the percentage variables was the total population who had completed their 
schoolings These variabilis have been listed in Table 

f _ . . . * ' 1 

Nature of Dwellings , 

_JThe_ nature. of_dweJlings_perxentage^arJ.ables_^vere_ based on^three_sepa>:a.te 

census' tables: Census Tables 31, 34 and 37 (CBCS, 1971 ; 10, 163, Those 
tnree tables described the nature of the dwellings in which the population 
1 iv/*d. . Table 31 described the typo of dwelling; separate house, semi- 
detached house, etc. Table 34 provided information about the size of 
those dwellings in terms of tiva number of rooms per dwelling* while Table 
37 provided information about the aj?e of these dwellings, 

(a) Nature of Dwellings: _TypQ* pf_PwellinE. * ; The census categoriz- 
ation of the 1 type of, dwellings in which the population -lived covered, four 
main dwelling types': houses, flats/units, non -permanent dwellings;, and 
non-private dwellings* The houses subgroup was, further broken into four 
types of house: separate, semi-detached, attached, and terrace houses. 
The flats/units "subgroup was divided into villa units, self-contained flats 



a3id j>on-SClf-COntuined fiats, Non-permanent dwellings were categorized 
as 'either improvised dwellings or caravans. The percentage variables 
obtained from this census information have 4 been listed in Table H*1Q* 
The denominator, used to calculate the percentage variables was the number 
of occupied dwellings. 

(b) Nature of Dwellings: Size of Dwel] ing„ The census description 
of the size of dwellings was presented by describing the number of rooms 
per dwelling* The categorization .of dwellings ranged from dwellings 
having only one room to dwellings. with seven or more rooms'. The denom- 
inator used to- calculate the percentage variables was the total number - 
of occupied : dwelling's * These variables have been described, iii Table H.ll . 

(c) Nature of Dwellings: Age of Dwelling , The census classifi- 
cation of the age of dwellings was linked to the time of the collection of 

.the census data in 1971 . The classification ranged from newer dwellings - 
built during 1971 to older dwellings built prior to 1966, This range of 
five years was designed by the ABS because information has been gathered 
at \five-year intervals for each population and housing census,' the detailed 

/information concerning dwellings built prior to 1 966 was therefore only . 
available from the data gathered during earlier censuses* Hie denominator 
used to calculate the percentage variables was the total number of 
occupied dwellings. These variables have been desci.Vibed in Tab 1 c H, 12, 

Ethnic Composition , „ 

The ethnic composition percentage variables wore based on Census Tables 14 
and 17 (CBC3, 1971:9, 10), v These two tables described the country of birth 
^and^the^peried of^Tesidonce^for^overseas^born^ residents, 

(a) Ethnic Composition: Country of Birthy The census table describing 
the country of birth of the overseas-bom population consisted of a 19- 
country and continent classification scheme with an extra classification 
denoted 'other* which referred to categories other than those listed* The 
denominator used to calculate the percentage variables was the total- 
population. The percentage variables dprived from the country of birth . 
classification have beeiulisted in Table H.13'. 

(b) Ethnic Composition: Period of Residence , The census' table 
describing the period of residence of the overseas-born population consisted 
of eight categories describing the number of years of residence. There' 
svere five categories which cohered from one to five years of residence J the 
other categories described the ranges S -9 years, 10-16 years and 17 or more 



pears of residence. Since this table focused on residents who were born 
overseas, the denominator used to calculate the percentage variables w&w 
the total population of overseas-born residents. . This denominator excluded 
those overseas-born persons who were not permanent residents of Australia. 
The percentage variables describing period of residence have been listed 
in Table H. 14. ^^^^ . ' 

Age Distribution ,-. 

The age distribution percentage variables were obtained 'from information 
An Census Table 7 (CBCS, 1971:8), The information presented in the census 
table describes the age distribution of the population in one-year 
increments from 0 to 24 years, and then five-year increments from 25 to 
69. The final census classification was denoted 70 years of age or older. 
These 35 categories were receded into eight .categories as. described in 
Table H*1S ? The denominator used to calculate the ' percentage variables 
was the total population* < 

General Facilities ■ ■ ■ 

The general facilities percentage variables were based on Census Tabios x 38 s 
39, 40 and 41 (CBCS , 1971 : 17} , These four tables presented information Q 
about certain facilities and services which were available in dwellings. 
Table 38 gave a detailed analysis of the availability of bathroom and 
kitchen facilities in each dwelling. Tables ,39 and- 4p described the numbers 
cof, dwellings which had access to the ''Services' of sewerage, electricity and 
television* ^;Table 41 was concerned with the numbers of vehicles, which 
were associated with dwellings.^- : 

(aj General facilities.: Ba throom and kitchen . The information in 
'the census table describing bathroom and kitchen facilities was in the .* 
form of a highly Retailed classification^ scheme P For each facility a 
dwelling was* classified as haying sole use s shared use, not shared use? 
and none available . These fo^r classifications were combined for bathroom 
and kitchen facilities into a 16-point classification scheme. This 
detailed list was reclassified into six new categories according to the 
re eo ding scheme presented in Table H . 16 . 'The six new categories, which 
were labelled 1 to 6, have been described in'.the Note at the bottom of 
this figure. . ' . \. 

. Following the reclassification of access to bathroom and kitchen 
facilities, the resulting six classifications were converted into percent- 
age jvariabi as' according to the descriptions presented in Tabl^ H.17. 



The denominator* used to obtain these percentage variables was the total . 
mjffffjer of occupied private dwellings/ 

1 (b) Gonoral Facilities! Sewerage, Electricity and Tel ev ision , 

Three percentage variables associated with the services of sewerage, 
electricity and television were prepared from the census information. The 
electricity, and television facilities were assessed by a simple counting 
of dwellings which had these services in use at the time of the census, 
The sewerage facility was defined as dwellings with/ a flush toilet connected 
to a public sewer*, Dwellings in which other forms of flush toilet were 
operating (for example, a flush toilet connected to a septic system) were 
not considered xo. have access to the sewerage facility* The denominator 
which was used to calculate the percentage variables was the total number 
of occupied private dwellings, The percentage variables describing these 
three facilities have been listed in Table H, 18, 

(c) General Facilities; -Vehicles , The percentage variables assoc- 
iated with the vehicles facility were derived from a census classification 
scheme which gave the number of vehicles per dwelling frtfm none to three 
or more vehicles. The percentage variables which have been calculated 
from this information have been listed in Table H.19. 1 The denominator 
used in these calculations was the number of private dwellings . . ■ 

. Living Arrangements ' ■ 

The living arrangejnents percentage variables were based on Census Tables 
30, 33 and 42 (CBCS, 1971:15, 17) . . These three tables presented inform- 
ation describing certain living arrangements of the ; population i Table" 30 
provided a classification of households .into living arrangements associated 
with family structure* Table 33 described the living 'densi ty f of persons 
per dwelling, The nature of dwelling occupancy, was summarised in Table 42, 

(a) Living Ar ran gemen t_s ; / Hous eho Id Class , The census table 
describing household class provided a detailed classification of the .types 
of households in dwellings. The census definition of a Household was a 
•person or group 4 of persons living and eating together? * The first major , 
class of household was classified as 1 single-family households', Other 
types of households ^were /separate family units' such as 'primary family 
units 1 in which the head of the family is also the head of the household, 
and 'secondary family units' which consisted of all other family units 
within the householdt In this -study, o^ily the major classification of 
single- family hous eho Ids was used to create the percentage variable, .> 



\ The ***3ehomiimt0l s used in 

perc^^ntage variflbJos de^i 
' Tabl«*-e 11,20., 

\ dcnszr^iny wof living arr^ng 
of iiwunates reeling r in ^ 
;, -front one inmcftc por;dwe2 
. denoswninator tisod to c^lc 
numb^er of occupied privs 
been listed, in Table H*^ 

» 1 . " - (c) U^jn£A_^ran|g 
tlwel^Cl-ing occupancy clus= 
oceu^pied 1 , which include 
was ^^to rokon into two ' c^te 
In tfc^iis study the two su 
ifj^MtinTi called tenant - 

. two ggaereentago variables 
calccmJiato these variable 



this calculation .was the total population. The 
scribing household class have boon listed 'in \_ 

gmontsi .^Density. The, census table describing the 
jemenis classified dwellings in terms of the number; 
;heso dwellings. The classification scheme 'ranged 
Lling to six or more inmates per dwelling. The 
iulate the percentage variables was the total 
Lte dwellings/ These percentage variabios^have . ' 
11 . *\ 

sfnentsj Occupancy . The census table .describing 
*ified occupied private dwellings into 'owner, 
sd purchaser occupied f and f tenant* occupied 1 * which 
igories^of tenancy* : state authority "and othorV , ■ 
fbgroups of tenancy were combined to form one class- 
occupied dwellings. The reclassification provided 
i listed in Table H*22, The denominator used *to 

is was the total number of occupied private dwellings 

* ■ * i * 

i -Student and- Betweof* -School Data Files 



The crfata^ file merging pi 
methc^^ds described above 
arfalB^sis* Af tor these t 
filers were* aggregated tc 
ieyeBa. of anaiy.sls, 



-ecedures and the "percentage variable preparation 
were carried out at the between-student level of 
:asks had been completed, the between-studont data 
* obtain files appropriate for the between-sehool 



The Weighting factczz>r information derived in Chapter S and the filter 
vari^mbies employed to c^^oate subsamples for the Jackknife error estimation 
techn^aique ^seo Appendix G) were then added to the data files at the* 
. ^pprc^Dpriate levels of animal ys is „ 

& In total there Wer^^ four eomputer-stored data files prepared fer^later 

analj*^ses # At tk iO-yep^x-old level the betWeen-student file was based on . - 

j6416 students) and the E^etween-scheol file was based on 272 schools* At 
* • - .t -_ " * ^ ■» 

the H^4^year"Qlu love! tra&e between-student file was based on 6045 students , 

and tehe ^etweeHehooi ^Sale was based on 256 schools, /; i 

Summary \ ; 

Thas chapter has desci*ita&ed the stages associated with, the preparation of 
th© c^oriiputer^ito^d data™, files used in this study, / " • " 



The data -wore dcriVc^from two sources : data gathered for the 
Australian Studios in School Performance (ASSP) project (Keeves and Baurke, 
1976) , and data gathered for the Australian Census of Population and 
Housing £CBC$, 1971), The' data from these sources wore linked together 
for each student by matching student home addresses obtained in the ASSP 
project with the appropriate Col lector 1 s District numbers associated with 
the .1971 Australian census, [ * 

* l^he raw census data provided information, in the formof f count f .data* 
These data were transformed into percentage variables in order to adjust 
for variations in population size ? numbers ofi dwellings) etc* between ■ 
Col lector r s Districts. The percentage variables provided information 
'Covering ton "main aroast workforce charaeteristicsj industry type, marital* 
status, religionj educational qualificationsj nature of dwellings , ethnic 
composition, age distribution, general facilities, and living aTrangenients . 

^ Four separate computer-stored data files were prepared for later 

For^the be 
10-year-c 

students'. The between-student data filesXwere aggregated to obtain between- 
school data files which described national samples of 272 1 10-year-old 
schools and 256 14/-year-oid schools, 



analyses. The two files" prepared for ^the between-student r level of analysis 
described national samples of 6416 10-ye.ar-old students and 6045 14-year-old 
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CHAPTER 7 
THE DEVELOPMENT OF THE INDICATORS 
Introduction 

The aim in preparing the indicators was to produce useful tools for the 
identification of educationally disadvantaged schools and students* While 
some efforts were mad© to design the indicators to have an 'appearance of 
reasonableness*, there was no attempt during ! o development of the 
indicators to derive constructs which had w* searched origins in the 

education or social science literature, The hi^ -t priority wa^s placed 
on the development of indicators which would maximise the precision with 
which resources allocated on the bas,is of these indicators reached\the 
students who were in most need of assistance* 

Separate analyses were conducted to prepare the indicators at each 
age level because it was expected that variations in the arrangement of 
school catchment areas between age levels would be reflected in the inter- 
relationships between the pieces of census information which described 
.the communities surrounding sample schools* 

Important Properties of the Indicators * - 

In order to guide decisions about the development of the indicators, a 
list of six items describing important properties of the indicators was 
'prepared: unit of analysis* nature of the criterion variable, statistical 
constraints, stability, parsimony and face validity* Following an examin- 
ation of- these items* a three-stage strategy was developed for the 
construction of. the indicators, 

1 Unit of Analysis , In Australia the units which have been . 
employed by the Matronal and State Governments to identify and assist 
educationally disadvantaged students have been schools* The identification 
of particular -schools, rather than particular studerfts, for participation in 
the Disadvantaged^ Schools Program was adopted as a funding strategy for 
.three -main reasons* First, the identification of disadvantaged schools 

prevented the possibility of 'streaming 1 which may have occurred if only 

•* ~ + ■ ■ *~ 

certain students within schools received supplementary assistance. Second, 
it was decided that the best way to combat the non -support ive home environ- 
ment of educationally disadvantaged students was to change the total school- 



environment. In order to achieve this change it was considered essential 
that ail students within disadvantaged schools should participate with 
parents, teachers, and school administration in the design and implement^ 
at ion of appropriate school programs, Third, there was a belief that the 
* concentration 1 in schools of students who came from non=supportive home 
environments resulted in handicaps which were Additional- to those 
associated with the backgrounds of individual students (Blaekburns 1979b i3). 

Since the school has been used both as the unit of identification 
and funding of educational disadvantage in Australia, the unit of analysis 
for the development of the indicators in this study was also taken So be 
the school. That is # the multivariate analyses required to construct the 
rndie nf ^1*^ from nensns information iv&je baged on School mean Scores which 
were prepared by aggregating student informaticn over schools* 

2, Nature of the Criterion Variable , In this study various pieces 
of census information were combined in order to form single constructs 
which were highly correlated with ^educational achievement. The combination 
of a number of measures, each of which may be an imperfect measure of the 
construct, into a more reliable combination is generally known as 'scaling* 
(Lansing and Morgan, 1971:279). 

In order to conduct the scaling procedure in an objective fashion it 
was necessary to select a criterion variable which had suitable character- 
istics with respect to reliability and validity. At both age levels data 
were available for a test of verbal ability, called the Word Ki owl edge Test, 
which had been designed for larg^ scale surveys conducted by the Inter- 
national Association for the Evaluation of Educational Achievement 
fThomdike, 1973). 

The development of basic verbal ability has long been considered to be 

a prerequisite for successful learning in the classrooms 

It has always been clear that ability to read with under- 
standing depends upon knowledge of the meanings of the words 
in which a message is expressed, (Thorndike* 1973'6l) 

An important recurring feature of measures of verbal ability has been 
their strong intercorrelation with other measures of school achievement. 
This property has often led researchers to employ verbal ability measures 
as useful surrogates for the assessment of other types of leaxningi 
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verbal ability is basic to most forms of achievement in 
school and in a symbol -oriented society like ours. It is 
paramount among the so called basic skills; and it correlates 
so highly with measures of achievement in readings mathematics, 
and factual information that it serves as a useful surrogate 
for the measurement of these other forms of learning. 

(Dyer, 1972:516) 

The Word Knowledge Tests used in this study were found to have 
reasonably high correlation with school achievement in the subject areas 
examined by the International Association for the Evaluation of Educational 
Achievement (TEA), For example, in the English-speaking countries which 
participated in the 1KA studies of Reading Comprehension and Science* 
the mean correlations between the Word Knowledge Test and Reading were 
0,73 and 0 B 70 at the 10 -year-old and 14-year-old levels respectively 
(Thomdike, 1973:62)* In addition the mean correlations between the Word 
Knowledge Test and Science were 0,76 and 0,60 at the 10-year-old and 14- 
year-old levels respectively (Comber and KeevoSj l?-73;249, 259), 

The mean reliability coefficients across the English speaking countries 
were 0*85 and 0,80 for the 10 -year-old and 14 -year-old levels respectively 
(Thorndike, 1973:58)* 

The relationship of the Word Knowledge Tests to a range of school 
achievement scores and also the satisfactory reliability coefficients for 
each age level which were established by the IEA studies provided support 
for the use of these tests as criterion variables for the seal ing procedures 
required in the building of the indicators from census information* 

3 Statistical Constraints. The units of analysis for the construct- 
ion of the indicators were schools* Data were available for 272 schools 
at the 10-year-old level and 256 schools at the 14-year-old level* There- 
fore, in terms of the botween-school analyses s any correlational analytic 
techniques which were employed had to acknowledge that there were limit- 
ations on the numbers of variables which could be used in order to avoid 
problems of instability which often occur when large numbers of variables 
are employed compared with the number of observations* 

There are no commonly accepted precise rules which describe the ratio 
of the numbers of observations to numbers of variables for multivariate 
analyses* However, several authors have suggested rules for particular 
analytic techniques which have been intended Xo provide approximations to 
a lower bound for the ratio* Cattell (1952) recommended at least four 
eases for 'each variable when using factor analytic methods- Kerlinger and 



Podhazur ( ii»7~J s. jested that between 100 and 200 cases were required 
for regression analyses which did not involve large numbers of variables, 
Tarsuoko (1970) stated that the sample size should preferably be at least 
three times the number of variables used in discriminant function analyses, 

Thomdike (197S3 has presented a method for estimating the •lower 
limit 1 for the ratio of numbers of observations to numbers of variables 
for a range of correlational procedures in social science research. This 
rule generally leads to more stringent requirements for the numbers of 
observations by comparison with the suggestions provided by the authors 
listed above, Thorndike f s rule, which was accepted as a guiding principle 
for this study, described the ratio in terms of an inequality statement: 
N 5 10(P+C) + SO 

where N - the number of observations, 

P = the number of predictor variables, 

and C = the number of criterion variables. 

Applying the inequality statement to the numbers of observations 
available for the betwecn-school analyses gave upper limits of around 21 
to 22 for the combined number of predictor and criterion variables, 

4 Stability : . The indicators in this study^ were built from census 
data. Since the Australian Census of Population and Housing has been 
conducted only once every five years, the preparation of the indicators 
had to ensure that the possibility of fluctuations in particular pieces - 
of census information over this time period would have minimal impact 
on the stability of indicator scores* 

For example, if the indicators were based solely on the workforce 
characteristics of the population then changes in industrial activity fox 
particular communities between each census might lead to erroneous measures 
on the indicator scores. Similarly, if only information concerning the^ 
ethnic composition of communities was used then an influx of migrants in 
particular communities would also result in inaccurate scores* 

In order to avoid these problems it was decided that the indicators 
"should™ i n co rpo rate" a~w i'de ran ge o f di f ferent types- o f ^census information ■,— — 
The use of information across a broad spectrum of population characteristics 
would then minimise the opportunity for changes in a small number of areas 
to influence the stability of the indicators between each census. 
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5 Parsimony , A key aim for the development of the indicators was 
to seek a parsimonious solution without loss of accuracy^ That is* while 
being simple with respect to structure and applicatiqn, the indicators 
were required to provide scores which accurately identified disadvantaged 
schools, and students, 

Simplicity in structure and application was considered to be important 
because it would minimize the errors, effort, and resources required to 
prepare indicator scores. The indicators which have previously been 
developed at National and State level in Australia have remained a mystery 
to all but those who have constructed thenu This has occurred because the 
techniques for the construction of these indicators have rarely been 
published $ or because the data required for the calculations have not been 
made freely available to the public, or because the complexity of the 
construction (for example f the "usiTf various varTab^e^r^cbHing - schemes) 
has been too difficult to duplicate without access to sophisticated 
research knowledge and computing equipment. 

In order to obtain the most accurate indicators with the simplest 
structure it was decided to employ the technique of forward stepwise 
linear regression (Kerlinger and Pedhazur, 1973), The forward stepwise linear 
regression technique is generally employed when the researcher's primary 
interest is to obtain the most accurate degree of prediction possible with 
the smallest set of predictor variables. The technique proceeds in the 
following manner: the predictor variable with the highest zero-order 
correlation is entered into the analysis- the next variable to enter is 
the predictor variable' that produces the greatest increment to the squared 
multiple correlation coefficient? this procedure is continued until the 
criterion f&v termination of the analysis has been satisfied, 

The termination criterion may consist of a statistical significance 
test or a 'criterion of meaningfulness* (Kerlinger and Pedhazur, 1973: 
286) . The use of a criterion of meaningfulness involves a decision by 
the researcher as to whether an increment in explanatory power is sub- 
stantively meaningful in the context of the research^appli cation - :^- In thrr~ - 
— stud^the^CTiteTion-of" meaningful 

additional variance required" to be explained before a variable was added 
to the indicator being constructed. The details of this decision have * 
been described in a later section, 
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6 Face Valid ity, A desirable feature of all types of indicators 
is that they should appear to be reasonable in terms of the construct 
which is measured by the indicator scores. Thomdike and Hagen (1977:60) 
have described this f appearance of reasonableness T as 'face validity* , 

It was extremely difficult to ensure that the indicators developed 
in this study had a high degree of face validity because of the units of 
analysis which were used. Theories and research which support relation- 
ships between environments and educational achievement at the between- 
student level of analysis have been widely established, However, these 
theories and relationships may not apply when data are aggregated to the 
between-school level of analysis,- 

For example f the well established correlation between the socio- 
economic status of a student's home and his/her performance on teXfs^oT^educ 
ational achievement may s or may not* be applicable at the between-school 
level. This may occur because the relationship at the between-school \ 
level will be influenced by the allocation of students to schools. If \ 
students were allocated to schools in such a way as to ensure that the 
school mean scores on the achievement variable were exactly equal s then 
the correlation between the two variables would bo zero when examined 
at the between-school level because of a lack of variance between schools 
with respect to school mean scores on the achievement variable. 

A further difficulty in establishing face validity occurred because 
the indicators were constructed from census information which described 
the communities surrounding each school , This information did not describe 
the characteristics of the families of students attending the sample schools 
except in so Etiv as they represented a small part of the neighbourhood. 
Thus there may' be certain census information which provided very useful 
predictors of school mean scores - however at the between-student level of 
analysis there might be^neither correlational nor causal connection between 
these variables iC- they -were derived from the particular family and school 
environments of the students . 

~ Th e above ^prio^WOT^ar e^ cferrtrari^o— a— ^B^^^m^hodolaQA£Ml^S3 s ue s_ 
which have generally been placed under the heading of 'ecological effects 1 
(Robinson* 1§S0| boga/t^and Rokkan, 1969) . These effects pose few problems 
in the analysis of data, However s difficulties may arise when relation- 
ships established at one level of analysis are assumed to apply at another 
level of analysis, 
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The accuracy of the indicators as predictors of educational dis = 
advantage was of paramount concern. That is, the performance of the 
indicators as tools for*^ecise allocution of resources was alven a 
higher priority than was a concern For the face validity of the pieces 
of census information which were combined to form the indicators. 

The actions which were taken to improve face validity were restricted 
to a careful watch for technical inconsistencies such as suppressor 
relationships in the multiple regression analyses and certain checks 
which were carried out during the data analyses in order to examine any 
results which were dramatically different between age levels, 

- _ . The Three-Stage Strategy Used to Develop the Indicators 

The six areas listed above were used to guide the formation of a four-stage 
s tra t^§y~ £ or^h^^e^rfflopmenr^of^he—i ndi cators . The strategy which evolved 
had to recognise that desirable solutions for the six areas were inter- 
related and, in some instances s contradictory a For example, the 1 stability 
requirement demanded that the indicators should be based on as many types 
of census information as possible 5 while 'parsimony* inferred that only a 
small subset of the large body of census information should be used* 

; Because of the impossibility of satisfying the needs of alL six areas 
simultaneously with any one indicator, it was decided to develop four 
indicators at each age level* , These four indicators were developed^to 
present a range of possible solutions to the problem of attempting to 
optimize performance across the often competing requirements of the 
seven areas. - 

The three stages in the strategy have been presented diagrammatically 
in Figure 7*1* The following discifssion has presented a detailed account 
of each stage. 

The first stage in, the development of the indicators commenced with 
the reduction of the 710 census direct- count variables to 148 percentage 
variables. This process was described in detail in the previous chapter. 
The percentage variables were then arranged into 22 groups which closely 
followed the structure and names of the source Census tables from whic* 
the percentage variables re derived* V,. \ • * ■ 

The second stage. involved the application of stepwise regression 
analysis to select a subset of percentage variables from within each of 
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Stage 1 



Occupational Status (Males) 
Consisting of a List of 
Four Percentage Variables 



\ 



Occupancy: 

Consisting of a List of 
Tvo Percentage Variables 



Formation of Linear Composites within each of the 
22 Groups of Percentage Variables by use 
of Stepwise Linear Regression 

i 1 J I' _ _.L 



Stage 2 



Gli Consisting of a 
Linear Composite of 
Two Percentage Variables 
L__ ,. s — 



-* .... » a 



G22: Consisting of a 
Linear Composite of 
One Percentage Variable 



\ I I 

Combination of the 22 Linear Composites into 

Indicators by use of Stepwise Linear 
Regression and Principal Components Analysis 
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Indicators 



Stage 3 



Figure 7.1 The Three-Stage Strategy Used to Develop the Indicators 
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the? group 5. The information contained within the "roups was then replaced 
by 22 'new variables • which wore based on linear composites of subsets of 
percentage variables in each group* 

The third stage required the combination of the 22 linear composites 
into the indicators. This stage employed stepwise regression analysis 
and 'principal component? analysis to combine the linear composites. 

Stage _I t The Construction and Grouping of the _Porcer,tagg Variables 

The original census information which was available for the study consisted 
of 710 direct-eount census variables, In order to adjust for variation in 
community si^c, and to re -organise the highly detailed information avail- 
able for some variables into a more manageable form* a, list of 148 
percentage variables^ was constructed. The preparation of these percentage 
variables has been described in Chapter 6, 

The total list of 14S percentage variables consisted of 22 groups of 
variables, each of which could be grouped and named in a fashion which 
closely followed the original table names and structure of the source 
census tabulations. These 22 groups 1 have been listed in Table 7.1.= The 
table has also listed the number of the source census table from which 
the percentage variables were derived f the number of the table in Appendix 
II which described the direct count variables which were, used as denominators 
and numerators in the construction of percentages s and the number of 
percentage variables in each group* 

The 22 groups of percentage variables have been listed under two 
broad headings: Social Environment and Built Environment. The groups of 
percentage variables associated with the Social Environment were based on_ 
descriptions of the characteristics of persons (for example. Occupational 
Type, Country of Birth and Marital Status), The groups of percentage 
variables associated with the Built Environritont are based on descriptions 
of dwellings and the population interaction with dwellings (for example, 
Type, of Dwelling, Bathroom/Kitchen Facilities and Density). For each 'of 
these two broid headings ? the groups of percentage variables have ; sen 
\ listed under sub-headings which describe' particular aspects of either 
the Social or Built Environments with which the groups of percentage 
variables were associated, . 
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Tabic 7 A The Grouping of Cv 


nsus Percentage Variables 














ViTO Up 


Percentage 
Source Census 'Variable 
Table Number Table Number 

in Appendix H 


Number of 
Percentage 
Variab 1 es 


Social Unvironment : 


Workforce Characteristics 




1 

■* 

3 
4 


Occupational Status (M) 
Occupational Status (F) 
Occupational Type CM) 
Occupational Type (F) 


26 
26 
28 
2S 

Industry Type 


HA 
}\A 
H-2 
11.2 


4 

A 
H 

12 

12 


S 


Industry TvpC 


27 

Marital Status 


II. 5 


13 


6 


Marital Status 


11 

Rel igion 


H.4 


b 




Religion 


22 


H-6 


5 






Educational Qualifications 




S 
9 
10 


Qualifications (Obtained) 
Qualifications (Studying) 
Qualifications (School) 


21 
20 

24 - 

Ethnic Composition 


H.7 
IKS 
11,9 


4 
4 
2 


11 

12 


Country of Birth 
Period of Residence 


14 

17 * 


HAS 
l\A4 


19 
8 






Age Distribution 






13 


Age 


7 


HAS 


8 


Built Environment i 


Nature of Dwellings 






14 
15 
16 


Type of Dwelling 
Size of Dwelling 
Age of Dwelling 


31 

34 
37 

General Facilities 


HAD 
MA I 
UA2 


in - ; 
7 
7 


17 
IS 
19 


Bathroom § Kitchen 
Facilities (Sewerage, etc 
Vehicles 


38 

,) . 39/40 
41 

Living Arrangements 


HA7 
HilS 
11,19 


6 

3 ' 
4 


20 
21 

22 


Household Class 

Density 

Occupancy 


30 

33 

42 " . 


H,20 
if. 21 

H,22 


1 
6 
2 


Tot 


al Number of Percentage Variables 




14S 






-lip 







S t a ye 2 : Thy Ue v el opine nt qQ i n oa r C o m po s i . t o s W i t h i n the Jli\e_ups_ °X 
Percent a go Va riables ... *■ 

After Stage 1 had been completed the original 710 direct count census 
variables had been formed Into 14S percentage variables f and these 
percentage variables had been grouped into sets which followed the names 
and structure of the original source census tables. 

The next task was to combine these percentage variables into 
indicators of educational disadvantage, The census information which was 
to be used to fortr the indicators was available at the individual level. 
That is, each of the sample members had been linked. to a set of percentage 
variables which described the Collector's District in which the sample 
member lived. Since the f unit of analysis* wasyrequired to be the schools 
the percentage variable data and the associated data for each sample member 
drawn from the ASSP study were aggregated over schools to obtain files of 
data covering 272 schools at the 10-ycar-olU level and 256 schools at the 
14 -year-old level ; 

One method of producing the indicators would have been to conduct 
regression analyses to combine the whole 143 percentage variables into a 
linear composite which was optimally correlated with a suitable criterion 
variable. However, the use of the whole 145 percentage variables would 
have violated the Statistical constraints' which required that a maximum 
of, 22 variables be used in any one correlational analysis. , 

. An alternative method would have "been to initial iy select n subset 
of the percentage variables which was small enough to satisfy the 'statis- 
tical constraints'. These variables could then have been used as 
independent variahJ js in, the regression analyses. This procedure would 
have presented difficulties in making decisions about which percentage 
variables to include in the analyses. For example, 'parsimony' required 
that the variables be selected so as to produce the most accurate 
indicators! and the need for 'stability' encouraged the use of as wide 
as possible range of different types of census information, * 

The method employed in this study was to draw information initially 
from as many groups of percentage variables as possible so as to maximise 
the 'stability' of the derived indicators, Also, it was decided that the 
stability of the indicators would be enhanced by using as many variables 
from within these groups as possible. The ' statistical constraints 1 on s 
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the. use of correlational procedures required that no more than 22 variables 
b .s lls cd in any one analysis, therefore this constraint could be satisfied 
by creating linear composites from each of the 22 groups and then using 
these' linear composites as individual variables in further correlational 
analyses to create the indicators, The 'parsimony* characteristic; could 
bo satisfied' by employing stepwise regression analyses within each group 
to create linear composites which were optimally correlated with the 
criterion variable. Those percentage variables .whrch did not add 
substantially to the explanatory power of the linear composites would then 
he discarded,' . . * 

Stepwise linear regression rather than simple linear regression was 
employed to create the linear composites of percentage variables within 
each group. This technique was used because of the need to extract a 
high degree of explanatory power from the information available within each 
group of percentage variables without including percentage variables which 
did not substantially add to this explanatory power. Within each group of 
percentage variables there was often a high degree of inter-correlation. 
For example, there were correlations of 0,74 and 0.33, between the percent- 
ages of male occupations which were 1 professional ! and the percentages of 
male occupations which were ''administrative/executive/managerial 1 , for the 
10-year-old and 14-year-old schools respectively. Because of this high 
degree of correlation between percentage variables within groups it was 
likely that the use of many variables from any one group would not add to 
the predictive power of the indicators. 

When stepwise regression is being used the researcher is required to 
make a decision concerning how many predictor variables will be allowed 
to enter the analyses before the procedure is terminated. The termination 
decision for these analyses was associated with the increments to explained 
variance in the criterion variable at each step of the analyses. The 
formation of the linear conposites was terminated when the increment in 
the amount of variance explained did not exceed one per cent, That is, 
when the change in the squared multiple correlation coefficient, H , after 
adding an additional percentage variable did not reach one per cent then 
the linear composite at that stage was accepted, 

7 

for certain analyses the restriction on .the contribution to R was 
relaxed to 0,25 per cent. This occurred for particular groups where only 
one- or two percentage variables were permitted to' be included in the . 
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analyses, It was eons idered that relaxation of the " restrict ion would not 
contravene the desirable characteristic of 'parsimony 1 when such small 
number^j of variables were involved in any one stepwise regression analysis* 
During the construction of the linear composites this alternative 
restriction occurred only at the 14-year-old level for two groups of 
percentage variables* Occupational Status (Females) and Period of 
Residence. ■ 

Prior to the percentage variables being permitted to enter the step- 
wise regression analyses an initial 'sifting 1 of" the percentage variables * 
was carried out* This sifting procedure was employed to minimize the 
opportunity for * suppressor relationships to arise-, by removing percentage 
variables exhibiting correlation coefficients with the criterion variable 
where the magnitudes of these coefficients were within the bounds of 
samp! ing error at both age levels, 
- s**S 

f An approximation to the standard error, of a zero-order correlation 
coefficient was employed to estimate the magnitude of two standard errors 
(Guilford and Fruchter, 19731145): ■ 

se « 3 '/.<„ 

where se(r) is the standard error of the zero-order correlation coefficients 
and n is the sample size under the assumptions of simple random sampling.. ■ 

The sample design for schools in this study was a disproportionate 
systematic stratified sample design. However, since the sifting procedure 
was to be used as a rough sorting device s it was considered that the 
approximation provided by the above formula would be sufficiently accurate. 
Therefore, in order to, enter the stepwise regression analyses $ a percentage 
variable had to exhibit a zero-order correlation coefficient with the 
criterion variable which exceeded two standard errors in magnitude. 

Results of Stage 2 

The second stage of the strategy required the combination of the percentage 
variables within each of the 22 groups of percentage variable groups to 
form linear composites. Since there wsre 22 groups of percentage variables 
for .each of the two age levels* there were 44 separate stepwise regression 
analyses required to create the linear composites. A detailed description 
of each of these has been reported in Appendix I. . ■ >" 

i ' 

A summary of these 44 stepwise regression analyses has been reported 
in Table 7.2* For each , group of percentage variables the number of 
percentage variables which entered the linear composites has been presented* 
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Overall there was a total' of SO ^percfentage variables required to^ create ^ 
the Jin ear composites at the 10-yeur-old level and 40 Tt,$he 14-year-old 
1'ey^l . The reduction, .from an original list oV US* percentage variabXes> 
represented a considerable gain in * parsimony 1 without loss in ^stability 1 
because 21 of the total 22 groups were represented =The s pfflitted group,, 
*A^e of Duelling', was not used to create linear -composvitcs because all 
percentage variables in this group failed to pass the gifting 1 grocoss 
iA both age levels. That is, all percentage variables in this group "did 
not have correlations with the criterion, variables which were in excess 
of that expected for normal sampling fluctuations, 

There was a total of 65 different ^percentage variables employed in 
the analyses* Of the 65 there were 36 percentage variables employed at 
tfeth age levels, and 14 which wore unique to the 10-year-old 'level , while 
15 were unique to the 14-year-old level, f : 

In the final four columns of Table 7.2 the percentage of the criterion 
variable variance explained by. the 'stepwise solution 1 and the ; full 
solution 1 have been presented, -OiP- percentage of criterion variable 
variance explained by the stepwise solution referred ^to the variance, 
explained bv the linear composite which was accepted to represent the • ^ 

■ - r - - . - , - ^ j 

appropriate group of percentage variables. The percentage of criterion 
variable variance explained by the 'full solution' referred to the variance 
"explained by allowing all eligible variables within 'a group to enter the 

■ analyses without^making use of the termination decision described in the % 
previous section? In many cases the full solution contained suppressor 

'relationships - with percentage variables" having differences. in sign 
between correlation coefficients and regression coefficients. An ^inspection 
of #he percentage of variance explained tjy each solution shpwed that " - 
generally tile reduction in the number of: variables included in a regression 
equation by the use of stepwise.-regresVion analysis caused Tittle loss in 
explanatory power while gaining greatly in firms of 1 face validity 1 and 

-also , parsimeny , * , ■ ? = 

Stage 5: The Development of the Indicators from the Linear Composites - 
The third stage in the strategy was the .combination of the iine'ar composites 
which had been formed at the second stage into indicators. After the second 
stage had been completed there were 21 linear composites available From the 
total of. 22 percentage variable groups. Since this number was 'within the 
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Table 7*2 The Results Of the Stepwise Reg res S 1 o n ^Ajiiilyjg s wh S L c h mqtq 

Used to Develop Linear Composites fYO mjtjie Group s crgjf 
? . Percentage^ Variables 





Numtip of Variables 


FirctntoQe of Criterion V 


^rime Explained 




in Linisr 


Stepwise Solution 


- Full Solution .- 


Group Source *■ 


Composite from 


of ^Linear Composite 


Stepwise Solution 


(JQO ft 


(ICQ R 4 ) 






iO-y-d ll-y-o . l 





1 Qecupationat=Status — (M) — — - 


— 






..--.12 -■*■*"» 


19 




- 19 - — - 


2 Occupational Status (F) 


2 


2 




5 


4 


s 


4 


3 Occupational Type (M) 


4 


2 




= A O 
42 


S3 


4.3 




* ULLUUaLiyual i jf US ^ t J 


4 


4 




38 


36 


40 


38 - ' ■ 




4 






37 


26 


39 


29 


* 6 Marital Status 


2 


1 




7 ■■ 


15 


8 ■ 






3 


4 




" 17 


18 


1-8 




8 Qualifications (Obtained) 


3 


3 




36 , 


29 


36 * * 


■ 2*9 


9^ Qualifications (Studying) 


2 


2 




10 


IP 




20 


10 Qualifications (School )_ 


2 - 


2 




IS 


23 . 




23 


11 Country of Birth - - 




3 




1 30 


22 




23 


12 Period of Residence 


2 


2 ■ 


0 


■ 


4 


9 . 


4 ._ 


13 Age 




2 






13 


as ■ » 


IB 


14 Type of Dwelling 


4 


5 - 




11 


■ i2K " 


is* 1 , 


23, 


15 Size of Dwelling 


— \ 


3 












16 Age of Dwelling 


* 


* 




* 


# 


* 1 


* 


17 Bathroom 6 Kitchen 




3 




* 10* 


27 


il/. 


27 _ - 


18 Facilities (Sewerage 3 etc) ^ 


2 


2 




■ 4 


15 '"' 




15 


19 Vehicles 


u 


1 






24 




24 ■ 1 


20 Household Class 


1 


1 






' 16 i 


6 J 


16 


21 Density 


1 


1 




17 






14 


22 Occupancy 


. 1 


i 




. 6 


~ s.: , 


19 V"?"' 


Total Number of Percentage , 














s 


Variables in Analyses 








SO 






. 98 , 


Number of Schools (Weighted) 








271^ 


ft £ 


271 ' 


256 



a, A t linear composite was not Extracted from the 1 Ale of ^velli^^ig 1 group 

because all percentage variables in this group failed to hsv«-« guff- 
■" .. ieiently 1 arge_gero=order correlations with the criterion var^x*iable. 
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limit set by thu ^ stat ist leal constraints 1 it was possible to employ 
correlational procedures on the whole set of linohr composites in order 
to form the Indie^^xors, Two correlational procedures were selected to 
be used In the ta^k of combining the linear composites: regression 
analysis and priri«^ipal components analysis. 

"the use of regression analysis for the total set of 21 linear 
composites was co— * side rod desirable because it would permit the construction 
of a linear combir^axion of the composites which had optimal correlation 
with the criteriosr^ variable. However, initial regression analyses at each 

age level using tl^e full set of 21 linear composites showed that the 

resulting tndicat^^x'S displayed suppressor relationships for some of the 
linear composites That is, although all 21 linear composites had been 

— — ^on&tliitcd to lmwe positive sere-order correlations with the criterion 

(see Append i x *1 ) » s e v e r aTTTOror compos-i t es_in_tfte_fj u ijl_je gressip n_ equation 
had negative regr^^ssion weights. These regression weights had occurred 
as a result of th^s high degree of collinearity between certain pairs of 

linear composites Since this occurrence would have been ineongruent-with=-= = - 

" the need for f fac^s validity 1 it was necessary to abandon the~ use of a full 
regression soluti<zz?n . - 

There Fore , izrsstead of employing all 21 linear composites in a regression 
analysis it was d^^cided to us'e stepwise regression to select a subset of 
the linear compos tes which would "avoid the, difficulties of suppressor 
relationships. The termination decision for the entry of linear composites 
into the analyses was to end the stepwise procedure before any suppressor 
relationships eme^^ged. That is* the linear composites would be allowed to 
enter the stepwis^^ regression until the addition of an extra composite 
. resulted in one o^sr more linear composites receiving negative regression 
weights. This te rm ination Uecision aimed to achieve maximum 'stability 1 
(by including aj many linear composites; as possible) without loss of 1 face 
validity 1 ' (by not- - allowing suppressor relationships to emerge in the 

indicators) - A c^^mparison of the proportion of variance explained by the 

2 T _ 

full set of linear* composites ? R" CfulL model) , with the proportion of 

variance explainoc3, by the subset" of lineaj composites from the stepwise 

regression analys^^s * R^, demonstrated that there was little loss in predictive 

accuracy by using "the stepwise solution* 
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In addit ion to s ^Meeting a subset of linear, con^posites from the total 
21 linear eompositeSi similar analyses were carriod out after initially 
— dividing them— into t\\^ groups associated with Xhc""So^c"asr~Enviit)nment"""~"an"d" 
the Built environment ^ 

The use of the Social Environment group of line— or composites was more 
likely to result in indicators wi^h higher 'Face val idity 1 because this 
group contained variables with well researched re I at I on ships to educate 
ional achievement at faoth between ^student .and betweo— n- school levels of, 
analysis. For example s the Occupational Status s Dec rupational Typc s Country 
— ^~of Birth * and: Qiialifi cations 1 inear composites all h ave well established 
correlational links v^It-h educational achievement, 

The Built Onvirox^ment group of 1 inear composite m was less likely to 
contribute to f faco validity* because 1 inoar compogi- tes such as Bathroom 
and Kitchen Facilities? , Vehicles, etc* do not in the^ iii sel ves appear to have 
well researched links with student educational perfQT^mance . Where the 
Built Environment typ^s of measures . have entered the research literature 
they have been used as indicators of unmeasured cong~"^cructs such as 'socio- 
economic class*. HowGrver, this group of, linear eompaQsites might be 
considered more likely^ to add to * stab i 1 ity' because changes in the 
percentage variables associated with the Built Envire=mment would be less 
likely to occur between tj census data collections than for the percentage 
variables describing tlie Social Environment. That i^s 4 during the five 
year period separating^ the Australian Census of Populdation and Housing, 
variations in * percentage variables such as Ene of Dv^vell ing,. Type of 
Dwelling, etc, would be less likely to be large even if changes in the - 
nature of population rfraracteristics such as QecupatSE anal Status, Country 
of Birth j etc, did occur..'— Fur-thc-r, since the Census was carried out at one 
point of time* the variables associated with thfe Bui EX t Environment would 
be 1 e s s 1 1 Keiy~t'o"T5G tjB j ec t 'to time-related variati ess n s in the social 
structure of communities which occur due to seasonal variations in work 
patterns, or social va^riations which may arise in conSbnunities which depend 
upon the travel/1 eisur^ industry . " 

The other correlational technique which was empl_oyed to combine linear 
composites into the indicators was principal eomponeit^-ts analysis. This 
technique was adopted because, it provided a means of obtaining high 
. Stability* [by including all linear composites) and a high level of 1 face 
validity' (by avoiding suppressor relationships) . Th _e principal components 



technique was used to oMntct a linear combination from all 21 linear 
composites which had maximum variation between trme units of analysis on 
^he~ derived indicators: This analytic procedure does not search for a 
linear combination with maximum predictive power as does the stepwise 
regression technique. Therefore At was expected that the correlation 
between the indicators derived from principal cor^iponents analysis :*nd the 
^e>i terion variable would be somewhat loss than tf=sat obtained fror.' full 
regression'analyses using the same set of linear composites. However, 
since the linear composites were constructed to t^ave a high correlation 
with the criterion variable, it was expected thu— the first principal 
component (which extracts the strongest single dimension from the relation-, 
ships among all the linear composites) would have a reasonably high degree 
of predictive power* 

Results for Stage 5 

The third stage of the strategy was concerned wi -zrh the combination of the 
linear composites to form the. indicators, Three sets of s^pwise regression 
-^ni^os^vere-^amed^ou^ 



21 linear composites, the second sot used only JUr^Qse linear composites 
associated with the Social Environment (Groups 1 to 13] , and the third set 
used only those linear composites associated witn the Built Environment 
(Groups 14 to 22]. The principal components analysis was carried out at 
each age level on all linear composite!* In Tab lie 7,3 the results of 
both the stepwise regression and principal compo^^ent analyses at each age 
level have been summarized. 

The entries in Table 7.3 have listed the metric regression coefficients 

for each linear composite which would be required to produce the -indicators , 

I * \ ■ _ 

The" metric regression coefficients for the indies/fcors derived from the 

stepwise regression analyses for all variables, SR(ALL) f have been reported . 

! ■ ■ ' v - • 

in the first" itwo columns of- Table- 7.3. At each sge level ^nine linear 

composites we|re s used to create the indicators, Eiowever, only four of 

these were common to both age levels' Occupation! a 1 Type (Females] , Country 

of Birth, Bathroom and Kitchen, and Density. At each age level the SR(ALL) 

Indicator contained six 'linear composites describing the Social Environment 

and three describing the Built Environment. 

The metric regression coefficients for the Sridicators derived from the 
Social Environment subset of linear composites, SR(SOCIAL) , and for the 
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Table 7,3 



Th e Co q f f i c i e n t s w hich w ere Used to Combi ne the Li nea r^ Compos it og 

into the Indicators 



















Croup Source 


Stepwi se 


Linear Regression 




Princ ipal 




A 


11 


Social Built 


Compon 


ent 






10 


14 


in 1 i in 


1 4 


10 


14 




1. Occupational Status (M) 




1 3 


11 52 ■ 




, 05 


04 




2, Occupational Status (F) 


•* 




* * 




^05 


OS 




3, Occupational Type (M) 


16 




11 * 




OS 


05 




4, Occupational Type (F) 




14 


22 33 




04 


05 




5* Industry Type 


23 


# 


19 * 




04 


05 




6." Marital Status 




38 


34 , 46 




06 


OS 




7 , # Religion 


* 




13 




04 


05 




Qualifications (Obtained) 


57 


* 


37 




04 


05 




9* Qualifications (Studying) 




SI 


* 55 




OS 


04 




10, Qualifications (School) 


* 




* * 




05 


OS 




11. Country of Birth 


19 


38 


22 34 




04 


04 




12. Period of Residence 


40 


* 


12 * 




04 


04 




1 3 , Age 


* 


pi 


38 53 




04 


04 




14. Type of Dwelling 


34 


* 


ah 

DU 




04 


05 




15. Size of Dwelling 


* 


14 


5S 


39 


05 


05 




16. Ago of Dwelling 


* * 


* * 


■ * 


* # 








17. Bathroom 5 Kitchen 


48 


30 


* 


42 


05 


04 * 




IS, Facilities (Sewerage , etc) 




* 




* 


05 


05 




19. Vehicles 


* 


f- 


56 


46 


06 


OS 




20. Household Class 


■ * 


* 


* 


* 


05 


OS 




21. Density 


42 


- 43 


"SI 


74 


04 


. 03 




22 . Occupancy 


* 


* 


* 


* 


06 


OS 




Regression Constant 
R 


-25,1 
72 


-25. 5 
73 


=18,4 -22.5 -24,5 
69 71 64 


-14- 
66 


9 -15,7 = 
69 C - 


14,2 
69 C 




R^ 


52 


53 


48 50 41 


44 v 


48 


48 




R 2 (fuin model} 


54 


= 54 


48 51 43 


45 


48 


48 




Number of Schools (weighted) 


271 


256 


271 256 . 271 


256 


271 


256 




Note: a Decimal points have 


been omitted. 


from coefficients 


and 


R/R~ values 







b All calculations were carried out using four decimal places. , Thi s linear 
composite had a regression weight of 0,0020 (See Appendix J,) 

c The R values refer to the value of the , correlation coefficierit between 
the indicator and the criterion variable. 

d Groups marked with an asterisk (*) refer to 1 inear compos ites_ which. .did. . 

not enter the stepwise regression analyses* Groups marked with two 
asterisks (**) refer to groups for which no linear composite was prepared* 



114 



12 



ERIC 



Indicators derived from the Built Environment subset of linear composites, 
SR(BuTLT)* have been reported in the second and third pairs of columns in 
Table _7_.3_. ■ 

. The SR(BUILT) Indicators contained four linear composites, three of 
these were common to each age level. The SR (SOCIAL) Indicators featured 
different numbers of linear composites at each age level : ten for the 
10 -v ear-old level and six for the 14 -year-old level. The five common 
linear composites , for the SR (SOCIAL) Indicators were ^Occupational Status 
(Males), Occupational Type (Females), Marital Status, Country of Birth^ 
and Age 

" The entries- in~the last two columns of Table 7.3 have recorded the 
metric regression coefficients for the principal , components analyses. These 
entries were the coefficients which would be required to create the first 
principal component from the' linear composites. The indicators derived 
from these analyses, PC (ALL) , employed the whole 21 linear composites at 
both age levels. 

The correlation between the indicators and the criterion variable have 
been recorded for each age level in the lower section of Table 7*5, These 
correlations ranged between 0,64 and 0.73, The highest values occurred 
for the SR{ ALL) indicators with correlations of 0.72 and 0,73 for the 10- 
year-old and 14-year-old levels respectively. The lowest values occurred 
for the SR (BUILT) indicators with correlations of 0*64 and 0,66. 

Summ ary ■ 

v - - 

This chapter has presented a detailed description of the procedures employed 
to develop the indicators of educational disadvantage* In order to guide 
decisions about the development of these indicators a list of six items 
describing" important properties of the indicators was prepared. Following 
an examination of these items, a three -stage strategy was prepared for the 
construction of the indicators* ~ 

The first stage of indicator construction involved the grouping of 
the 148 percentage variables* described in Chapter 6, into 22 groups which 
described various aspects of the neighbourhoods surrounding the schools in 
the sample. At the second stage* stepwise regression analysis was used to 
combine the percentage variables within each group into a linear composite 
by using school mean Word Knowledge scores, as' the criterion variable. The 
resulting 21 linear composites at each age level were employed in analyses 
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to construct four indicators of educational disadvantage at the third stage* 
The third stage involved the preparation of three indicators based on step- 
wise regression analyses which also used school mean Word Knowledge as the 
criterion variable, the SR(ALL) indicator employed all linear composites 
as candidates for entry into the stepwise regression analyses, the 5R(50CIAl) 
indicator used only those linear composites with aspects of the social 
environment P and the SR (BUILT) indicator used only those linear composites 
associated with the *built environment. A further indicator j PC (ALL) , was 
also developed by employing all linear composites in a principal component 
analysis". " ~~ " • • - <~ = • •• • 
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L.; CHAPTER S * , ^ 

THE INVESTIGATION OF INDICATOR CHARACTERISTICS 

- Introduction 

'5 __ . 

In the previous chapter the three-stage strategy used to develop the 

indicators was described. In this chapter the indicators were examined 

with respect to a range of analyses which were designed to provide a 

detailed investigation of their properties. These analyses examined 

the nature of the dimensions assessed by the indicators; the predictive 

power of the indicators with respect to school mean achievement and school 

'behavioural climate, the precision with which the indicators could be used 

for resource allocation, the properties of school mean achievement scores 

following residualization by the indicators, and the theoretical and 

•cross -age f stability of the indicators as predictors of school mean 

achievement. 

"■ Relationships Between Indicators 




The degree of similarity in the dimensions assessed by the indicators was 
examined by calculating the product moment correlations between the 
indicators both within and across age levels. These correlations have 
been presented in Table 8.1- s 
Within Age-Level Correlations . In the upper left-hand corner and lower 
right-hand corner of Table 8.1 the correlations between the indicators 
within each age group have been listed. For example, for 10=year-oid 
schools the correlations between the PC (ALL) indieatdr developed at the 
10-year-old level and the SR(ALL) , SR(SOCIAL) ,' and SR (BUILT) indicators 
developed at the 10-year-old level were 0,96, 0.95, and 0.90 respectively; 
the corresponding values for 14-year-old schools were 0.96, 0.94, and , 
"D . 94 respectively. " "*""""" "* 

The correlations for each age group of schools were all high and 
positive between 0,80 and 0*97 .which supported the previous assertion that, 
within age levels, .the indicators were aligned along a common dimension* 
Intact, except for the two intercorrelations between 5R(SQCIAL) and 
SR (BUILT) ,0,80 and 0.83, the intercorrelations were all in the range 0.88 
to 0.97. The slightly lower intercorrelations for SR (SOCIAL) and SR(BUILT) 
were due to the fact that ea^h contained relatively few percentage . 
variables and none of these were common to, either indicator. 



N 
N 

09 



.Across* 



Indicator 





* 

10-Year-' 


Did and i4-Yaar-QId Schools) . 


i 














Indicator 




ItVYear-OId Indicators 14~Year-Qld Indicators 



(ALL) SR (SOCIAL) SR (BUILT) PC (ALL) SR(ALL) SR(SOCIAL) SR(BUILT) PC [ALL] 



lQ-Year-Old Indicators Applied to 10-Year-Old Schools 



i] . 100 

SR(SOCIAL) 95 

SR(BUILT) 88 

PC(ALL) % 



100 

io : 

93 



• 100 
90 



100 



14-Year-Qld Indicators Applied to 14-Year-01d Schools 



SR(ALL) 92 
SR(SOCIAL) 81 
SR(IUIIT)... 88- 



17 
M 



92 



93 
13 



92 



94 



97 



87 


> 80 


• 83 . 


90 


as 


IS 


73 


87 


Si 


.. 74 


94 \ 


90 


90 


88 


86 


97 



100 
§7 
Jl 



100 

Jl 

94 



ML 



100 



a Decimal points have been omitted from correlation coefficients. 

b Number of schools at I0»ycar*old/i4-year-old levels (weighted) a 271/256. 
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The PC (ALL) indicator had eonsistently high intereorrelations with 
Other indicators at both age levels: averaging 0,94 for the 10-year-old 
schools and 0,95 for 14-year-old schools. This reflected the larger 
number of percentage variables which were common between the PC (ALL) 
indicator and the other three indicators. 

Across Age-Level Correlations . In the upper right-hand corner and lower 
right-hand corner of Table 8,1 the across age-level correlations between 
indicators have been listed. . • 

The most interesting . feature of these .two matrices, of correlations 

was their diagonal elements. These elements represented the intercorrel- 
ations between the same indicators developed at different age levels, 
For example * for 10-year-old schools, the SR(ALL) indicator developed at 
the 10-year-old level had a" correlation of 0.87 with the SR(ALL) indicator 
developed at the 14-year-old level, These same two ^indicators had a 
correlation of 0.92 when applied 1 to the 14-year-old schools. 

The diagonal elements were all high and positive in the range 0,85 
to 0.9? which demonstrated that, despite the structural differences in 
any^nOnBiclfof developed tor the""Wb^ge^l~e~ve 1 S T each indicator was™ - " 
aligned along a common dimension no matter to which sample of schools 
it was applied. This characteristic was particularly noticeable for the 
PC (ALL) indicators because the intercerrelation between the two forms of 
this indicator was 0.97 for both 10-year-old and 14-year-old schools, 

School Neighbourhood Correlates 

In the following discussion, a brief review has been presented of the 
relationships between the four indicators and the percentage variables 
which formed the basic building blocks in the construction of these 
indicators. The percentage variables provided conceptually simple descrip- 
tive information and were therefore suitable for an exploration of the 
nature of the dimensions assessed by. the indicators". 

From 'the large lisr of 148 percentage variables a subset of 26 was 
selected in order to cover a range of important characteristics of school 
neighbourhoods t occupation, education, housing, family structure, facil- 
ities, and ethnicity, These 26 percentage variables and their correlations 

. ' \ ' 

with each of the four indicators have been listedXfor the 10-year-old and 

14-year-old sample schools in Table 8.2, For example., the percentage 



variable describing the percentage of the male worKfor^e in professional 
occupations, *QCC .Fft0F(M), Had correlations at the l6-ye^ ^ar-old level of 
0,80* O.S2 f 0i67s 0*78, y and correlations at the 14*}'eatf-*<old level of 
0, 73, 0,7S f 0,62, 0,76 with trie indicators SR(ALL) ~ f -SftfSt^ClAL) , SR(BUILT) , 
PC (ALL) , respectively, 

The general pattern of correlation coefficients p^f o ^-js anted" in' Table 
1.2 was similar across ago J^vcIb. High positive hifiESi negative cooff- 
icients between particular, j^rccntage variables and an i^sidicator at one 
age level were generally associated with similar eo^fficr^ents at the 
o ther "age leve 1 V Th i s cons i ^twic)' #5Ugges ted that $ lie Bp i ~ c e the s t ructura 1 
differences in a particular indicator between age levels any one 
indicator was aligned along a coHQOn diniens ion for botb ^ge levels, 

For all indicate rs*W%rs was a fairly even leV^l the magnitude 'of 

correlation coefficients across the main areas desc^ib^d ... by the percentage 
variables:. That is s there \Ajs no particular area of t^e description of 
school neighbourhoods which had dominated the const^ucjjie^on of the t 
indicators at either age leyoi, pgr exaffiplej the 5i^fAL.L™) indicator was 

hig hly correlated s both posit dvely and negatively 3 wl'th tragrcentage^ 

variables describing the are^is of occupations educatiow, housing* family - 
structure, facilities, and ©trinicity. 

The complex nature of dimensions which wer^ ap«ssed by the 
indicators can be s^een E^om an inspection of the oV^raxl pattern of sorrel 
ation coefficients across %W nain areas assessed by t}$o percentage 
variables* ■ 

■ " A high degree of educatiofiiil disadvantage * whi^h you^ild be evidenced ' 
by low scores on the indicators) tfouid tend to be asi0^i^3.ted with, schools 
whose neighbourhoods had the following characteristics : high percentages 
of parsons in the workfe^e© with low status .occupation^ reprocess /manual/ ■ 
labour, unemployed) and low Percentages with high status occupations 
(professional j admin i St tW iyO/ejioeutive/ manager i al t cl^r^ical] ; high 
percentages of persons whp had never attended School atjd low percentages 
of persons with high educational attainment (schooling giszreater than level 
9i bachelors degree); high percentages of dwellings wh^cfea were rented, 
over-crowded (6 or more persons per dwelling) s subgtan^a^^d in structure : 
(improvised house) _ and low p or centage s wh i ch were o^fljtif ^and large in 
structure (7 or more rooms); high percentages of pe^so^s with 'broken' 
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Table Correlations Between the Indicators and ^Subset of Percentage 

Variables (10-Year-Qld Schools and 14-Year-Qld Schools) 



Percentage Variable 



% OCC ADM/EXEC/MAN CM) 

% OCC PROF (M) 

% DWEL:' 2 VEHICLES 

% BACH D OBT (IS*) 

% DWEL: 7+ ROOMS 

V SCHL GT LEVEL 9 

*~ OCC "PROF ( FM) - . 

% DWEL: SL (B+K) 

% DWEL: OWNER OCCUPIED 

% POPN : SINGLE FAN! HSHOLD 

% OCC CLERICAL (FM) 

% OCC CLERICAL (M) 

% OCC ADM/ E XE C/MAN (FM) 

% WKF UNEMP (FM) 

% DWEL: IMPROVISED HOUSE 

% WKV UNEMP (M) 

% NEVER ATTND SCHL 

% POPN: STH EUROPE BN 

% DWEL: SHARE (B+K) 

% DWEL: TENANT OCCUPIED 
i 

% SEP (EVER MAR M 15+) 
% SEP (EVER MAR FM 15+X 
% DWEL: NO VEHICLES 
.% DWEL: 6+ INMATES 
. % OCC P ROC/ MAN/ LAB (FM) 
% OCC P ROC/MAN/ LAB (M) 



Indicator 


SRf ALL) 


SR(SOCTAL) 


SR(E 


iUILT) 


PC(ALL) 
10 14 




x 


10 


14 


10 


14 


84 


72 


86 


76 


72 


70 


84 


78 


SO 


73 


82 


78 


67 


62* 


73 


76 


5S 


70 




"74 


63 


74 


- 71 . 


82 


70 


67 


73 


72 


56 


55 


67 


68 


55 


62 


62 


67 


63 


60 


62 


65 


61 


59 


64 


62 


52 


51 


63 


64 


61 




68 


68 


49 


45 


59 


57 


39 


63 


21 


47 


50 


77 


41 


66 


35 


55 


37 


53 


52 


61 


48 


63 


33 


58 


20 


51 


40 


66 


40 


i 66 


S3 


45 


48 


42 


49 


44 


49 


SO 


53 


39 


50 


38 


47 


34 


47 


41 


ri 


39 


54 


43 


39 


34 


4g 


38 


-21 


-27 


-24 


-31 


-26 


-24 


-27 


-28 


-25 


-40 


-OS 


-26 


-39 


-57 


-24 


-41 . 


-21 


-44 


-24 


-41 


-27 


-46 


-31 


-44 


-33 


-44 


-17 


-31 


-44 


-59 


-33 


-48 . 


-40 


-4 a 


-42 


-49 








-48 . 


-35 


-60 


-27 


-54 


^-26 


-59 - 


--37 




-30 


-48 


-34 


-48 


-48 


-53 


• -44 


-ss 


-32 


-55 


-30 


-55 


' -34 


-55 


-43 


-62 


-32 


-53 


-36 


-55 


-42 


-51 


-4S 


-58 




-59 


-31 


-56 


-38 


-64 


}» 


-69 


-5 a 


-SO 


-50 


-39 


-65 


-55- 


/-48 


-38 


-SB 


-49 


-64 


-53 


-44 


-38 


-57 


-45 


-77 


-74 


-SI 


^76 


-66 


-68 


-81 


-78 



Note : a Dec-imaV points- h ^ ve ~ been omitted for correlation coefficients . 

b Number of schools at lO-year-old/14-year^-oid levels (weighted) 
'm 271/256. * ■ * ' - 

c Confidence limits for correlation coefficients based on two 
standard errors were -0.07 for 10-year-oTd schools, and ±0.08 
• for 14-year-old schools* (See Table 8.5, footnote c.) 

d The 26 percentage variables were listed according to their 
mean correlation -across all .four indicators* 
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marriages (persons once marfWand IS years of age Qider^o mm 
separated) and low percenteig^j of persnns living in stn^l g Ml}- houses - 
holds; high percentages of dwellings with limited facilities (shared u»« 
of kitchen and bathroom, n D Vehicles} and low percentages of dwellings 
with facilities (sole us© of jdtchen and bathroom, 2 vehicles); and hiffi^ 
percentages of the population born in southern European countries * 

The above profile of xh% type <-z>f school neighbourhood aisoei^ted 
with schools having low sC O f%5 0n tfr^e indicators provided spicule of a 
community in which there 3 concentration of a range 0 £ mini 

_rihvs_i.c al_ cone 1 i t ions, wh i eh h c^Vc commo n T y b e en described in %mi 0 f 
•disadvantage , 1 deprivation and poverty' . Therefore, while a pr^m&tim 
had been placed on the deve Ib^cnr cz^^-iTidicTitn-rs-whi-c^-H^d- -high p^edic&^ ve— 
cy in terms of school ^can acE^ievement, the final indicators e^h£bitd 
ghlv desirable property of baling balanced co r r^ ki t i D nal as s o c i a& i on s 
a number of environmental conditions which bot^ indavlduaU/ »nc=i in 
combination have often beO n 'j>jopose-<5 as important har r isf s to achieving 
the goal of . equality of educational opportunity, 

SQhffi ai Achi -gvement _Co?re^late£ 

In Table S.3 the correlation cooffi giants for. the relationships b^tw^ecr^ 
the Indicators and school stores on the Word Knowledge, literacy-, 

and Numeracy tests have t^en jiresen xed separately for iQ-y^Nld m4 
14-year-old schools, ' 

The correlations between the indicators and scbOgl scores Wei=3f® 
mostly in the range of Q.Ao toO.70 , Generally higher ' cWW^ ^ wo=re 
associated with the Word knowledge -casts , This was t 0 h& dffct«d 
because school mean scores oh these- tests had been uSgd £4 scaling 
criteria in the development of the indicators, 

Correlation coefficients loss =than 0,60 Were obtained for the, Sp(SOClAL) 
indicator with school msan Scores oyn the Numeracy test at ag§ l^v-^is 3 
- and also for the SR(AlW -sw'^KIAUO indicators with s^W* J mi §co^e» 
on the Numeracy test at the j>yoar- -old 

individual correlations - 3 $an correlations for in.d*c2Ws across a~it 1 
school mean scores exc^d^d o^O nrtd were mostly in the j-<uf 0,6$ to:*0 .70 
for both age levels. 



In order to evaluate the magnitude of the corrections pres en tea Xti 
Table 3*3 it was necessary to examine some other -Studies which had 
developed indicators of educational achievement : .^JLny^articular s two 
points of comparison were considered to be of groat importance - First* 
kcre the magnitudes of these correlations comparable with those from 
other large-scale studies in which indicators of school /neighbourhood 
environment have been ^constructed from census information? And soeO*ui » 
were the magnitudes of these correlations comparable with those frpm sth^T 
large-scale studies in which indicators of school neighbourhood envir^^ 
meat have bceli"cmT5t , ruet-od_by obtaining detailed information = from 
individual students about their own home 'ehviTonments?^ 

_^-^-^ -Tlie^ \ r-s t que s t ion _ was e xamin e d o 1 1 ow i n gja_ Xpyx e w_ojf J he^tUjj jJyL^^ 
carried out during 1973-1977 by Levine and coworkers at the University o$ 
Missouri , and the second question was examined following a review of the 
findings of cross-national studies conducted during the early 1970 f s fry 
the. ^International Association for the Evaluation of Educational AchifeVfe- 
meat (IEA) , ' • 

' These two sets of studies^ were selected because^ they had certain 
features which were important for the valid evaluation of the two qu^ejAjis: 
Both sets of Studies had: 

1; imported analyses which were carried out at the between-schooj JdVeX 
of analysis* 

2. designed their analyses to optimize the correlation between indip^tdTS 
of the school neighbourhood environment and school mean achievement sCQf^s, 
*3* employed sufficiently large numbers of schools in their analyses to 
ensure stability in the obtained correlation coefficients. 

4*. conducted replicated analyses across different groups of sample s^fr^oH. 
(Across big-city school systems in the Unj-versity of Missouri studies , 
across school systems in different countries in the IEA studies*) 

The IEA studies had two further important characteristics * First 
results had been reported for Australia on the same target gopulatioii ^$ 
"vfasT employ &B^foT~ tit e"! 4^y e a r -o id^s ch oo r s ~ in this s t udy * an d s e cond iy ~r~~%gfi<QQf 
mean achievement scores had been calculated by using the same Word KiioWlgdgs 
test as was used in this study, 4 ■ > 

The University of Missouri studies lacked precise comparability i*l 
these two important areas, The target populations for these studies w^r^ 
associated with a group of big-city school systems in the United States # 
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Tab lo S , 3 Correlations _B_r ;t :w o en the Indie atot_s_and _S c h o o 1 M e an Scores 
■ - on the Tests of Word- Knowledge , Literacy and Numeracy 

(lO-Year-Qld and 14-Year-Qld Schools) . 



School Mean Scores 






Indicator 






SR(ALL) 


SR(S0CIAL3 SR(BUILT) 


PCCALL) 


lu^iiar-uia indicators 


Applied to 1*0 


-Year-Old 


Schools 




,10 -Year-Old Test 










Word Knowledge 


72 


69 


64 




Literacy (Test iOR3 


71 


62 


69 




Numeracy (Test ION) 


Si 


51 


62 


58 


Mean Correlation 


67 , 


61 


65 


65 


14 -Year-Old Indicators 


Applied to 14- 


^Year-Old 


Schools 




14-Year-Qld Test 








■ i 


Word « Knowl edge 


73 


71 


66 


69 ! 


Literacy (Test 14R) 


70 


64 


68 


67 


Numeracy (Test' I4N) 


66 


, 57 


69 


63 


Mean Correlation « 11 * 


70 


64 
t 


68 


66 



'rfo^S 5 ^ a Decimal points have been o litted' from correlation coefficients . 

* Number of schools at 10-y ^ar-61d/i4-y^ar-old levels (weighted) 

m 271/256, . j 

-.. * / 

■ •» i 

/ 

and the school mean" test scores were mostly based oh standardized achieve- 
ment tests. However, this set^pf studies was selected because it appeared 
to represent the only research carried out to date which has employed both 
tne same derail e<j linkage of schogis to their census -described catchment 
ar&as, and the same stepwise multiple regression approach to the prepar- 
ation of census -based eompbsite^predictors of school mean test scares as 
was emjftoyedV in this study. / 

: ~ _ - ' ; •• m ■ _ i 

In - the following discussion a short review of the relevant /procedures 
and results associated with the University of Missouri and lEA/studies has 
been presented* The two questions listed above have then been 1 addressed , 
following a comparison of the magnitudes of the appropriate c&rrelation 
coefficients with the results obtained in^ this study, / 
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The Un t ve rs i t y o f Misso uri Studies: Review and Comparison 

In a series of studies carried out at the University ofMissouris Levine 
and His co-workers investigated the utility of census descriptions of 
school catchment areas for predicting school mean achievement scores 
(Levine et al , 1975; Levine et al , 1974 ; Meyer and Levine, 19 76 ; Levine 
et al , 1977; Meyer and Levine , 1977} . ' 

This series of studies commenced with an investigation (Levine et al , 
19 73} which aimed to assess whether independent variables based on census 
information for school catchment areas could be used to predict school 
mean scores on achievement tests, Levine et al reasoned that if the 
predictive power of the census information was sufficiently accurate then 
easily retrievable data from the census could be used in the preparation 
and revision of formulae used to allocate resources to schools* 

A sample of 122 elementary schools in Chicago was selected for the 
study. Each school's catchment area was linked to its census 'block' 
boundaries thereby permitting the preparation of census descriptions of 
the neighbourhoods from which each school obtained its students. Data 
describing the mean reading achievement scores of sixth grade students 
in each school were obtained from the official test ing p ro grams carried ._ 
out by the Chicago Board of Education, 

Levine et al demonstrated that a multiple correlation coefficient of 
0,87 could be obtained when only four census variables. Percentage of 
Females Separated* Percentage of Families Which Lack One or More Plumbing 
Facilities, Percentage of Dwellings which are Owner Occupied * and Percent- 
age of Dwellings with 6 Persons or More* were used as independent variables. 
The composite census measure was shown to have predictive power which 
compared favourably with composites 1 which had earlier been constructed 
from data describing the particular family circumstances of individual 
students , 

\ 

Further results from this study, which were published in a. separate 
report C Levine e t al , 1974) , considered the predictive power of census 
composites for both fourth and sixth grade levels over a number of years. 
In these analyses three census variables, and several product terms created 
from these three variables*, were used to construct the composites. The 
-va riabie- Pcrrceh Lag e o f Famil ies~ Wh-rch~Lack One""or" More p l umbi n g Fae TlTfTi es 
was excluded from the analyses, Multiple correlation coefficients in the 
range of 0,80 to 0 , 9.0 -were obtaiVied when school mean reading achievement 
was used as the criterion, ■ 
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A supplementary set of analyses presented in this report used census 
•tracts' rather than 'blocks 1 as the unit with which to describe school' 
catchment areas. The tracts covered a larger geographical area - each 
being composed of many blocks. The composites resulting from these 
analyses employed logarithmic, square root , and quadratic transformations 
of the independent variables. The predictive power of these 'tract-level' 
composites were generally of similar order to those created from" 'block- 
level 1 information - 

Meyer and Levine (1976) employed similar methodology for the prep- 
aration of block-level data in a study of 48 elementary schools in Kansas 
City. However the construction of composite predictor variables included 
both , census descriptions of school catchment areas and a set of variables 
denoting neighbourhood typology classifications which had been derived 
from a variety of factor analytic and clustering techniques. The multiple 
correlations for the resulting composite measures were again generally in 
the range 0.80 to 0 ,90 when school mean scores on standardised achievement 
tests, the Iowa Test of Basic Skills and the Stanford Achievement Test , 
were used as criterion measures for samples of , fourth, fifths and sixth 
grade students . 

Levine et al (1977) and Meyer and Levine (1077) extended their exam- 
ination of the association between school catchment area social character- . 
istics and school mean achievement scores by conducting analyses which 
were replicated in five big city school districts! Chicago, Cleveland, 
Cincinatti, Kansas City, and St Louis, The census -based descriptions of 
school neighbourhoods were supplemented' with data obtained from local 
government agencies and school district offices. The unit of census 
information selected to describe school catchment areas- was the census 
tract. In each of the five cities reading achievement data were gathered 
respectively from 275, 105, 69, 55, and 65 elementary schools. Certain 
transformations of the independent variables (logarithmic, reciprocal % 
quadratic ^ and square root) were tested in order to explore whether predict- 

ns of school-level achievement obtained from stepwise multiple regression 
i alysis could be improved by taking curvi linearity into account. 

The stepwise regression procedure reported by Meyer and Levine selected 
from five to nine independent variables across the five cities and obtained 
"multiple corre lit i on^oef f i c lehts = at the s ixth grade~~leve"l aero ss several— 
years averaged 0,88, 0.77, 0.91 , 0.85, and 0,84 respectively for the five 



cities. The selected i mlopendcnt variables were mostly logarithmic trans- 
formations; very few * unt runs formed 1 variables entered the final regression 
equations* Across the five cities there was a large range of different 
types of variables selected however the researchers concluded that the high 
intereorrelat ion among these variables demonstrated that they were 
reflecting differing aspects of a complex situation involving disorganiz- 
ation in biihscitv social systems (Meyer and Levlne, 1977:18). 

Hie multiple correlations between the composites describing school 
neighbourhood environments and school mean achievement criteria were 
generally in the range of 0,50 to 0.90 across all of the University of 
Missouri studies. These values were consistently higher than the multiple 
correlations of mostly around CK7Q whoa school mean achievement scores on 
tests of Word Knowledge were used as criteria in this study. 

The differences in the predictive power of the composites most probably 
have their origins in differences between the nature of the target popu- 
lations which were examined, From the estimates of the coefficients of 
intraelass correlation given in Table 3.4, it may be seen that the between- 
school component of variance in Word Knowledge scores in the United States 
is almost twice the size of the Australian value at both the lO-year-old 



and 14-year=old leve T%~, Con s e queTrtT>s affa lywsTDTrdu^te^at—t he-43etw &m\~= 

school level for similar criteria could be expected to have a larger amount 

of cri terion ^variance available for 'explanation 1 in the United States * 

Further, since the University of Missouri studies considered only school 

systems in large cities it could be expected that the Well-known high 

degree of residential < segregation in cities like Chicago would result in 

census percentage variables exjiibiting a greater degree of variation 

between school neighbourhoods when compared to school neighbourhoods for 

- _ • _ - \ - - _ 

Australia overall. Inspection of the reported standard . deviations for 

some census percentage variables in fact confirmed this speculation. For s 

example, the percentage variables in the Chi cagd" studies C Levin e et al 

1975:18) which described the percentage of females who were separated and 

the percentage of dwellings with six or more inmates had standaroS^deviations 

which wore around five times and two times larger respectively thai^ for the 

same variables describing Australian school neighbourhoods ^at both age 

levels, ■ =-- \ 



^He^i-t— was—possible-^ 

composites and school mean achievement scores were quite different between 

/ ■ : 

127 

.' , * t - i 



140 



ERIC 



countries, it would appear reasonable to suggest that the comparatively 
large 'restriction in range' in both the independent and criterion 
variables was in part responsible For the relative 'attenuation 1 of the 
magnitude of the multiple correlation coefficients in the results for 
Australia (Nunnal ly, 19o7 : 126 ; Allen and Yen* 1979:34) . 

ThelEA Studies! Rqy_iow and Comparison 

As part of an international study of educational achievement conducted by 
the International Association for the Evaluation of Educational Achievement 
(TEA), Comber and KeeVes £19733 developed a composite measure- which was 
intended to assess the educational climate of the homes of students 
attending their sample schools. This measure was conceptualized as being 
partly associated with the 'socioeconomic level' of the students' parents, 
and partly associated with the ' cultural . level 1 of the students' home 
environments, A single indicator, called 'The School HanJicap Score, 1 , was 
developed for each school by combining information describing these two 
areas* This indicator was prepared in order to assess the effectiveness 
of the education provided by the school after allowance had been, made for 
the nature of the community in which the school was operating. ! 

Following an inspection of both between-student and between-school 
^cor foTa t^^n^naT/T^^e^T^^l^^va rt aM e s— WOT-e^seXeotod^t^ f o rm_ th e_ Seh o o 1 Han c 
cap Score* Father's Occupation, Father's Education , Mother's Education, 
Use of Dictionary, Number of Books in the Home, and = Family Size, The 
Father's Occupation variable was ■prepared by the application of criterion 
scaling (Beaton j 1969) to a 9-point occupation classification system. 

The researchers used regression analyses to determine the weights 
required to combine the six variables into the School Handicap Score, 
For each country the six variables were included in* separate between-school 
analyses with school mean test scores for Reading, Science and Word Knowledge 
as criteria. The averages of the regression weights were calculated and 
rounded to form the weights for combining the six variables into the , 
composite measure. Since Australia did not gather Reading scores the 
rounded regression coefficients were taken from analyses using Science and 
Word Knowledge as criteria. , - 

The correlations between the School Handicap, Score and school, mean 
- achievement score s on the tests of Word Knowledge, Reading, and Science 
have been presented for 12 countries in Table 8.4. Australia participated 
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Table 8,4 Correlations Obtained .ring the ll;A Six-Subject Studios Between the 'School Handicap Score' 





and ScIp 


,}J Mean Ach it 


neunit fur 


Tests of iVord Know 


ledge, Read/mg ml St 


ilencc. : 














\ 


Country / 

; 


-., — 




Age 


Level 




Number of 5 c 


hools 




10-Year-Old 






ui -uici 


Tfii-YpMr^Ohi ] 


4 ^"ear-Old 


Kurd 
Knowledg 


e 


Science 
■ 


ivord R 
Knowledge 


ending : Science 


Australia 


- 


> 


- 


n 


59 


- 


■ 221 


England 


SO 


77 


Si 


S3 


S3 SO 


' 162 


144 


Finland 


44 ■ 


SO 


32 




at 78 


97 


77 


Germany (FRG) . 


42 




■ 45 




68 


68 , 


■ 85 


Hungary 


76 




a 


(4 


76 45 


'152 ' 


210 


Italy ' 


48 


41 


26 




57 ■ 37 


264 


327 


Japan 




- 


61 


= 


as 


250 


196 


Netherlands 


= P 

5S 


65 




71 


70.. 56 


60 




New Zealand 


= 


= 




74 


70 66 


= 


, 74 


Scotland 


so . 


84 


si" 


. SI 


87 * 90 


' 104 


7.0 ', 


Sweden 


44 


47 


' 48 


' 47 


27 29 




tit 


United States 


30 


70 


,81 


■ 84 


82 78 


' 255 


m 



Mean Correlation 61 64 5S 74' 73 63 



Note;' a Decimal points have been- omitted from correlation coefficients! ■ 

b The source of correlations for Science was Comber and Kccvcs (1973:205, 215}, and the sources- 'of 

. . correlations for Reading 'and Word Knowledge were various computer printouts which described the 

'. between -School analyses carried out during the I HA Six-Subject Studies (IEA, 1972). 

c. A 'dash in the table (-} means that the country did not gather data which would allow the 

: calculation ni a correlation coefficient, 
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in only thv Science pha^o of the TEA studies at the 14 -year-old level. 
Therefore no correlations wore available at the 10-year-old level 'or at 
the 14-year-old level for Reading. 

Since both the Word Knowledge Tests and the sample 6r> Igns used at 
the 14 -year-old level in the Australian IEA studies xhe same as was 

used in this study it was possible to tsmkd *v ( )m@ i r " vf comparisons between 
the predictive powers of the School )JutWllcap ScO ra and the census based 
indicators. _ 

The correlation listed in Table 8.4 between the IEA School Handicap 
Score and school mean achievement in Word Knowledge at the 14 -year-old 
level was 0.73. The correlations listed in Table 8*3 for the census based 
indicators (SR(ALL) , SR (SOCIAL) , SR(BUILT) , and PC (ALL) were 0.73, 0.71 , 
0.66 , and 0.69 respectively* That is, at the 14-year-old level SR CALL) 
had equivalent predictive power to, the School Handicap Score with respect 
to school mean Word Knowledge scores and the other census based indicators 
had slightly lower predictive power. Furthers while there were no other 
common measures of school mean achievement used in either study ~ it was 
important to note that the correlations between the census based 
indicators and school mean achievement scores in Literacy and Numeracy all, 
except for one correlation of 0,57, considerably exceeded the correlation 
of 0.59 between the IEA School Handicap Score and, school mean achievement 
in Science. - - 

No data were collected at the 10-year-old level for Australia in the 
IEA studies. Therefore it was not possible to make direct comparisons 
between the predictive power of the School Handicap Score and the census 
based indicators. However, the proximity of the correlations for Australia 
at the 14 -year-old level to the mean correlations for the IEA countries 
listed at the bottom of Table 8*4 s suggested .that the mean correlations 
at the 10-year-old level might bo a fair estimate of the results which 
would have been obtained if data had been gathered at the 10-year-o Id. level 
> in Australia. Following the pattern for most other countries we would 
expect that, if data were available, the correlations for Australia at the 
10-year-old level would be slightly lower than the values established 
during the IEA studies at the 14-year-old level. 



If these assumptions were accepted as being reasonably accurate , then . 



inspect ion o f^h^^COTTOr ationa -fe r^ens-us— based— indicators in Table 8.3 
showed again that the predictive power of the census based indicators . 
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would compare favourably with the predictive power of the School Handicap 
Score at the 10-year-old level in the IEA studies* 

*» 

Social and Learning Handicap Correlates 

The examination of the properties of the indicators was extended beyond 
their educational achievement correlates by considering information, 
provided by classroom teachers, which described the students in terms of 
certain social and learning handicaps* It was important to note that the 
validity of this information depended on classroom teachers 1 perceptions 
rather than, for example * the skilled diaghosis^ of a psychologist* However, 
it was argued that the daily contact of classroom teachers wrth their 
students would enable the teachers to provide sufficiently accurate inform- 
ation because the social and learning handicaps considered were based on 
overt student behaviour rather than more abstract constructs such as 
attitudes and aptitudes. 

* The responses •provided by teachers about the 25 students in each 
sample school were scored dichotomously and then averaged to obtain a 
school mean score on each response. For example, the item which considered 
the 'social acceptance 1 of students required the teachers to state whether 
each sample student was 'Rejected or avoided by other students f ? 'Tolerated 

by other gttiden*- 3- j -,-- L L i kgd by -Jthgr-stju riflntg ' . ■ 'Wsi 1 Hked fay other » 

students' s or 'Very popular* sought out by other students 1 . The first 
two responses to this item were scored * 1 * and the other responses were 
scored *0** Thus* when averaged for a sample school, this item, referred 
to the proportion of students in assample school who were 'Tolerated or 
Rejected by Students 1 , This school mean characteristic has been listed 
as the first item under the •Social Handicaps* heading in Table 8,5 . 
A similar scoring procedure was adopted for all other items in Table, §*5. 
Detailed descriptions of these items have been presented in Keeves and 
Bourke (19763* In general a high score for, a school on an item showed 
-that the school had a high proportion of students with that, ^particulars — — = — 
handicap, ^ 12 - 

The correlations between the indicators and each of the school mean 
characteristics have been listed in Table 8*5 for schools at each age level* 
For example the item describing the proportion -of students in a school who 
had 'Difficulty in Using Pen/Pencil 1 had correlations of -0.14, -C-llj 

-0.16, and - 0 * 1 2 a t_ the 10- y ear -p ld_ le vel and correlations of - 0, 26* . 

iO.24, -0.23, and -0.22 at the 14-year-old level with the indicators SR(ALL) 9 - 
SR(SOCIAL) , SR(BUILT), and PC(ALL) respectively. 



Tab 1 e 8 , 5 Co r ro I a t i o n s B c t w e en t he Cen s us - Bas e d Indicators an d^ S ch o o 1 Mean 



Scores for the Descriptions of Student Characteristics (IQ-Year- 
Old School 5 and 14 -Year-Old School s> 



School Mean Characteristics ' Indicator 

SR(ALL) . SRCSOCIAL) ~ SR (BUILT) PC (ALL) 
10 14 ' 10 14 10 14 10 14 



Social Handicaps 



Tolerated/Rejected 


-21 


-09 


-19 


-11 


-14 


# 


-19 , 


-08 


Unable to Co-operate 


? -42 


-17 


-11 


-16 


-IS 


. -17 


-11 


-17 


Shy/Timid 


-23 


-12 


-21 


* 


-13 


-17 


-20 


-OS 


Abnormal Le.vel Activity 


-29 


-OS 


-27 


-08 


-25 


-12 


-28 


* 


Isolates Self 


-11 


-10 


- -09 


-08 


-10 


-11 


-11 




Mean Correlation 


-19 


-11 


-17 


-10 


-IS 


-13 


-17 


-10 



Learning Handicaps 



Using Pen/Pencil 


-14 " 


-26 


-11 


-24 


-16 


-23 


-12 


. -22 


Following instructions 


-30 


-23 


-22 


-23 


-29 


-23 


-29 


-23 


Copying Written Work 


-23 


-27 


-19 


-27 


-23 


-27 


-21 


-27 


Spelling Simple Words 


-29 


-30 


-24 


-27 


-29 


-32 


-27 


-31 


Reading Reversals 


-29 


-16 


-20 


"-12 


-30 


-19 „ 


-28 


-IS 


Classroom English 


-19 


-10 


-10 


-OS 


-18 


■"'-1.3 


. -18 


-08 


Mean Correlation 


-24 


-22 


: -IS 


-20 


-24 


-23 


-20 


-16 



Note: a Decimal points have been omitted from correlation coefficients* 

*b Number of schools at lQ-year-old/14-year-oid levels (weighted) = 271/2S6, 

e The standard error for correlation coefficients at the between-school 
level of analysis was estimated by using the Jaekknife technique, 
The results of these analyses have been reported in- Appendix The 
average standard error for correlations was 0,035 and 0,042 at the 
10-year-old and 14 -year-old levels respectively. This gave confidence 
limits, based on two standard errors of -0,07 for 10-year-old schools 
and -0.08 for 14-year-old schools, Correlation coefficients which did 
not exceed two standard errors in magnitude have been marked with an. = 
^ ^asterisk "(*)~»~"~ - ——=— r —" — . — «- v-.--._- r ta .______ __ 



All correlations between the indicators and the items describing 
social and learning handicaps in Table B. 5. were negative, At the 10-year- 
old level all correlations exceeded two standard errors in magnitude, and 
at the 14 -year-old level this also occurred for the majority of the 
correlations, A low score on any of the four indicators would tend to 
identify a school having relatively high proportions of students both 
with social handicaps [associated with being tolerated/rejected, unable 
to cooperate, shy/timia\ s isolated s and abnormally active) and learning 
handicaps, (associated with difficulties in using pen/pencils following 
instructions, copying written work, spelling simple "words, understanding 
classroom English, and exhibiting reading reversals). 

The pattern of correlations in Table 8*5 enhanced the confidence 
which could be attributed to the use of the indicators as indicators of 
educational d i s advanta ge* Although the develo pment o f the indicators had 
emphasised the need for high correlations with school mean achievement 
scores, these correlations showed that the indicators were also signifi- 
cantly related to a range of school mean behavioural characteristics which 
in themselves have been accepted by classroom teachers as both symptoms 
and causes of the inability to engage in effective learning* . 

Precision in Resource Allocation 

The precision with which the indicators may be used to make resource 
allocation decisions was compared by constructing a table of average 
Accuracy and average Leakage coefficients for, the Literacy and Numeracy 
tests at each age level* The Word Knowledge tests were not used in these 
comparisons because they had been used as the key scaling' measures during 
the development of the Indicators and hence evidence concerning these 
tests would have lacked generalizability* 

In Tables 8.6 and 8.7 the values of average Accuracy coefficients and 
average Leakage coefficients, based on the theoretical model developed in 
Chapter 3, have been compared with coefficients calculated from sample 
data for the census -based indicators* ; 

The coefficients of intraclass correlation for the Literacy and 

Numeracy tests were applied to the theoretical model in order to obtain 

* ■ ■' ^ , . ■. . . 

the 1 optimal I average Accuracy and Leakage values. The corresponding 

Accuracy and Leakage^ coefficients for the indicators were calculated from 

^ a mplo 'da t a by u& ii i g the L wo -way table de s c rib e d 1 1 1 F i gm u 8. 1*- — 
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Students in Schools with Indicator 
Scores Above the 10th Percentile 
for Schools 



Students in Schools with Indicator 
Scores Below the 10th Percentile 
for Schools 



Students with Test 


Students with Test 


Scores Below the 


Scores Above the 


10th Percentile 


10th Percentile 


for Students 


for Students 


n 

a 


V 






n 

c 





Figure i ■ 1 An Example of the Two -Way Tables Required for the Calculation 

J_ of Accur^cy_..and^LeakaEe .Coefficients for the Census -Based . 

Indicators* 



s The example table in Figure "8.1 split the^Tample of students into 

\four groups each of size n^, _n_ 5 and n^ respectively. The average 
accuracy coefficient for schools with indicator scores below the 10th 
percentile for schools and students with test scores below the 10th 
percentile for students was then estimated by lOOn^/Cn^+n^) , For the 
theoretical model this corresponded to the value of average A(l0,p^) 
taken over the lowest 10 per cent of schools* 

For example, at the 10- year-old level the estimated average Accuracy 
fc coe ffic ient I was 21,4 for schools with SR(ALL) indicator scores below the 
10th percentile for schools and students with Literacy scores on Test 10R 
below the 10th percentile for students. The corresponding theoretical 
model value based on an intraclass correlation coefficient of 0*156 was 
estimated to be 33.9. This theoretical model value was calculated by 
using -PROGRAM NORMAL (See Appendix G) . 

—The differences between the average Accuracy estimate obtained for 

an indicator and for the theoretical model provided a measure of the 

*loss' in Accuracy associated with using the indicator, rather than school 

mean test scores, to identify, groups of students with low test performance. 

* \ * 
In the above example i the theoretical model value of 33,9, represented an 



estimate o f the f opt ima 1 * average Ac curacy va 1 ue f o r Li t ©racy s cores on 
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ible 8,6 Comparison of Average Accuracy/ Leak :^ C oefficients Obtained For the Indicators with Qi 
; AccuraqVUakaiie fagfrielinti Obtained fro m the lieofetica l Model (IQ-Year-Qld Sclioois) 



Indicator ' ,) Groups of Schools 

tot 10', of 'Schools ^ "' Lowest S< of Schools 
Leakage 



' "'" Accuracy 

Lowest 10i Lowest 
Students Students 



Accuracy Leakage 
lowest 101 . Lowest 201 
Student? Students 



= -' r" 

Literacy [Test XOR: 


roll ■ 0.156) 










■ 


SR(ALL) 


21.4 


3S;5 


2S,6 


20.1 ; 


51.'J 


50.4 


SR(SOCIAL) 


19,4 


34.0 


2B,0 


.17.5 


32.8 


33.0 
55.2 


SRfBUILT) 


21,6 


33,2 


36.9 


18.7 , 


33,4 


rC(ALL) 


18,7 


34.0 . 


27.9 b 


19,4 


.34,6 


■30.8 


Theoretical Mods! 


■ 

33.9 


■ 




' 26.2 


' .42.0 /, 

■ 


24. S 


Nuneracv (Test ION: roh § 0.122) 




f 








SR{ALI.) 


19,2 


31.3 * 


. 29. S ' . 


17,2 


29.5 

i 




SRCSOCIAL) 


1.7.5 


32,6 


32.2 


1S.3 


28.9 


56.6 


SR(BUILT) 


' 1S.0 


32,r 


33.7 


17.2 ' 


■■ 27.S 


37,6 


PC(ALL) 


15.9 


31.1 


34,5 


17.4 


' 30.3 


54,7 


Theoretical Model 


32,1 


47.7 


21.4, 


24.9 . 

* 


40,1 


2o.9 



Note: a Utf of schools/students at 10-year-old level (weighted) 
* -b, Number of schools/students at 14-year-old level [weighted] 



271/6416. 
236/6046. 



Mean Difference Between 
Indicator and Model _ 
Accuracy "Leakage 
Losses' Losses 



-9.5 
-12.1 
-10.1 
-11.4 



•11.5 
-12.5 
-12.4 
-12.5 



+6,0 
+S.5 

+8.1 
+7.4 



+10,3 
+11 ;S 

+10.5' 



Test 10R at . the 10-year-old level .' The value of 33.9 estimated the percent- 
age of students at the 10-year-old level in schools with mean scores on 
Test IDE below the 10th percentile for schools who had Test 10R scores 
which were below the 10th percentile for students* The 'loss 1 in accuracy 
for this example was 21.4 -33*9 ^-12.5. 

Similarly* the average Leakage coefficient f or_. _-th e - S R ( A L L ) indicator - 
applied to Literacy scores at the 10-year-old level was 25.6 which repres- 
^ rented a 1 loss f of .25.6 - 19,2 = +6.4 compared to the theoretical model 
estimate* . - — -- , = . . 

Since the theoretical model average Accuracy values were the optimal 1 
highest average Accuracy values and the theoretical model average Leakage 
values wore the 'optimal 1 lowest average Leakage values s the 'losses* 
for Accuracy and Leakage were less than or equal to sero s and greater than 
or equal to zero, respectively. The indicators could therefore be judged 
^in terms o£ their -precision for identifying low performing students by 
comparing the magnitudes of the losses in Accuracy and Leakage, The most 
desirable indicator* had 'losses 1 which approached sere (From below) for 
, average Accuracy values and which approached^ zero (from above) for average 
Leakage values , ' 

- The first three columns of Tables 8,6 and 8.7 have listed the estimates 
of AdQ.p^)* AQO.p^), and L(p,) taken over the lowest 10 per cent of 
schools. The second three columns in this table have listed the same 
coefficient*! taken over the lowest 20 per cent; of schools* The final two 
columns ^ere obtained by calculating the mean losses separately for the 
four estimates of average Accuracy coefficients and the ^two .estimates of*"* 
average Leakage coefficients which were associated with each indicator*, 

' For Literacy scores at the 10-year^old ^evel the SR(ALL) indicator n 
has the lowest average Accuracy loss* 9*3* and also the' lowest average 
Leakage loss* 6,0* The lowest average losses fcrr both Accuracy and Leakage 
also occurred for the SR(ALL) with respect to* Numeracy at the 10-year-old 
level and Literacy at the 14-year-old level* At the 14 -year-old level the 
. SR (BUILT) indicator had slightly lower average losses for Numeracy than 
the SR(ALL) . indicator* The SR(SOCIAL) indicator had the highest average 
losses in Accuracy for Literacy and Numeracy at both age levels. 



Table\?* Common of Average Acciiracy/LeukauQ Coefficient obtained for the indicators with 'Optlrcl' Avorap 
, Accuracv/Leakage Coefficients Obtained from the Theoretical Model flMcar-Old Schools) 



Indicatsr 






Groups of Schools i 




Mean piffc 
Indicator 


•mice Bct'"~™ 
and Nel 


Lowest 10 


i of Schools 


K Lowest M of Schoo 


Is 




Accura 


ev 


Leakage Accuracy 


Leakage 


Accra* 


• T Leak 




Lowest .10* L 


owest 2 OS 


Lowest W Lowest 201 ; 




Losses 




/'. ■ 


K . Students 5 


tudents 


Students Students 









SR(SOCIAL') 
SR(BUILT) 



Theoretical Model 
Numeracy (Test 14N; roh = 0-150) 
SR(ALL) : 
SR(S0C1AL) 
SR(BUILT) . ; 



i 


52.4 


* 16,7 


20,8 


33,2 


32.5 • 


*4,5 


+4 


35.7 

28. 9 ; 


47,7 


21.3 


55.4 


32.5 


4,7 


+& 


31,0 : 


48.6 


\ 

20.2 


21.4 


55.4 


33.9 


-5.9 


+7 


29.S . 


49.2' 


21,1 


! 21,1 


35.5 


33.7 ■ 


-6.3 


*/ 


35. S 


. 52,8 


16.8 


' 27.5 


44.0 


22.6 • 







TJiowtical Model 



27,3 


44,7 


26,6 


IE. 9 




56,4 


25.4 


• 111 


27.8 


18.4 . 


51.5 


' 37.4 


27.5 


44.0 ' 


: 27.1 


.20.11 


55.8 . 


• 54.7 


25.4 


40,9 : 


' 217 


■ 13,5 


32.8 


, 35,1 


33.6 


' . 49,8 


19,5 


.26/0 


41.7 1 


25,1 



Me; a- Suaber of schooYs/studeiits at 10-year-old level [weighted] ■ 271/6416, 

i 

b Number of schools/students at;i4^car-Dld level (weight^) = 256/6046, 
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-7;o 

>9.5 



-6,5 + ^ 
=3,4 +£S* 



1 n yost igat_lon of Residuals 

The school neighbourhood information which w^s used th construct the 
indicators was based solely on census percentage variables* However two 
other variables, Type of School (Government f Catholic s i Independent) and 
School Location' (Metropol itan , Non-Metropol itan) s were, available from 
the data used to construct the sampling frames, While these variables 
did not give specific information about the nature of school communities s 
they could be seen as surrogate measures for certain community character- 
istics which have been shown to be correlated with educational achievement . 
For example, communities having many students who attend non-government 
rather than government schools may differ a great deal in terms of income, 
attitudes, and aspirations. Also* communities having many students who 
attend non -metropolitan rather than metropolitan schools may differ in 

terms of physical and social isolation, 

\ 

Inspection of the means on the Literacy and Numeracy tests for the 
categories of the Type of School and School Location variables revealed a 
consistent pattern across both age levels . The Type of School variable 
categories showed that .the means for Independent schools were higher than 
for Catholic schools which in turn .were higher than for Government schools. 
Also, the School Location variable categories showed that the means for * 
Metropolitan schools were higher than for Non-Metropol itan schools* This 
general pattern of achievement across different types of schools in 
Australia has also been documented in studies carried out by, the Inter- 
national Association for the Evaluation of Educational Achievement (KeeveSs 
1978) . , ^ • • 

These two variables therefore provided an opportunity to examine the 
nature o/ the residual variation associated with the use of the indicators 
as predictors of school mean achievement in the basic skills of Literacy 
and Numeracy, Accordingly, a between-school stagewise regression technique 
was useci to assess whether the Type of School variable and the School 
Location 1 variable could be used to explain differences in school mean 
achievement, scores 'over and above 1 the differences explained by the 
indicators. For each age level each of the indicators was initially intro- 
duced into a regression analysis using, in turn , ^school mean Literacy 
scores and school mean Numeracy scores as criterion, variables - At -a 
second stage of the analyses two dummy variables (Independent School s 

i : * \ " 

Catholic School) created from the three . categories, of 'the Type of School 

. 5 " ■ \ « 

..." " : ■ v . 
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variable and one dummy variable (Non-Metropolitan School) created from 
the two categories of the School Location variable were entered into the 
regression analysis* 

The results of these analyses have been summarised in Tables 8,8 and 
8*9, For each regression equation the correlation coefficients between 
predictor and criterion variables (r) and the multiple correlation coeff- 
icient for the two stages of the regression analyses (R) have been -listed. 

The correlation coefficients displayed a similar pattern for all 
predictor variables. Large positive correlation! were obtained for the 
indicators and correlations smaller in magnitude were obtained for the 
dummy variables* The correlations between the dummy variables and the 
school mean scores for Literacy and Numeracy followed a pattern which had 
been expected after examination of the means of the categories of the 
Type of School and School Location variables! positive correlations were 
associated with the Independent School arid Catholic School* dummy variables 
and negative correlations were associated with the Non -Metropolitan School . 
dummy variable. The correlations presented for school mean scores in 
LrteracyT"at bo-th age levels, all had magnitudes in excess of two standard 
errors after adjustment for the sample design, However, for school mean 
scores in Numeracy, the correlation with the Non-Metropolitan School dummy 
variable was slightly within these limits at the 14-year-old, level and the 
correlation with the Independent School dummy variable was well within 
these limits at the 10-year-old level* 

Statistical tests were conducted to assess whether the contributions 
of the second stage variables to. predictive power were significantly - 
different from zmvp, A statistically significant contribution at the 95 
per cent £ level has-been /denoted by an asterisk beside the multiple correl- 
at ToTTc^befficient at the second stage* There were no statistically 
significant contributions obtained for^any of the analyses conducted at 
the 10 -year-old level. | However at the 14-year-old level six of the eight 
stepwise regression analyses showed statistically significant contributions- 



The statistically 
14 -year-old analyses iV 



significant contributions found for certain of the 
f erred that the hypothesis that the second stage 
contributions to predictive power ^were— :2ero was rejected at the 95 per 
cent confidence level , J\ An inspection of these significant contributions 
demonstrated however tha^t the r practical r contributions to preUictive 
power were virtually negligible. This negligible practical contribution 
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Table 8,8 Stepwise Regression Analyses Used to Examine Residuals 
for School Mean Literacy Scores (lQ=Year-Qld Schools 
an d 1 4 - Ye ar-Q Id Schools) 

Stage Variable Regre5_sion_^Equation_=w4th Literacy Criterion 

I SR(ALL) SR(SQCIAL) BR (BUILT) FC(ALL) 

/ \ r R r R r R r , R 



10 


-Year-Old Schools 


















1 


Indicator 


71 


71 


62 


62 


69 


69 


67 . 


;• ' 67 " . 


2 


Independent School 


09 


71 


09 


63 


09 


69 


09 


67 




Catholic School 


11 - 




11 




11 




11 






Non-Metro School 


-15 




-15 




-13 




-13 




14 


-Year-Old Schools 


















1 


Indicator 


70 


70 


64 


64 


68 


68 


67 


67 


2 


Independent School 


30 - 


71* 


30 


65* 


30 


72* 


30 


70* 




Catholic School 


20 




20 




20 




20 






Non-Metro School 


-09 




-09 




-09 




-09 





Note: a Decimal points have been omitted from correlation coefficients. 

b Number of schools at i0-year-oid/i4-year-oid levels (weighted) 
= 271/256. 

c Confidence limits for correlation coefficients based on two 
standard errors were ±0*07 for 10-year-old schools, and *0,0S 
for 14 -year-old schools * (See Table 8.5, footnote cO 

d Cpn^Fidence limits for multiple correlation coefficients were 
taken to be equal to those for correlation coefficients, 
This followed results presented by Ross (1978) concerning the 
similarity of design effects for these two statistics for 
stratified sample designs* . \ 

e The statistical test for the significance of the contribution 
of the second stage variables to variance explanation was based 
on the formula, for the F statistic g i vjen_ by Thomdike ( 19Z§Al§?)=i 
An asterisk (*) has been placed beside the R value for^ the second 
stage of the stepwise regression analysis, to denote that the 
contribution to explained variance* at the^second stage was 
significantly different from zero at the 9S\per cent confidence 
• 1 evel . » 




may be seen by comparing the very small changes between the multiple 
correlation coefficients for each stage of the stepwise, regression analyses, 

Further, at the 14 -year-old level, the relatively high zero order 
correlations between the Independent School and Catholic School dummy ; 
variables and school mean scores on the Literacy and Numeracy tests had 



Ta bio B » y Stepwise Regression Analyses Used to Examine Residuals 
for School Mean Numeracy Scores (1 Q-Year-Old Schools 
and 14 -Year-Old Schools) 



Stage Variable 







SRfALL) 
r R 


SR (SOCIAL) 
r R 


SRCBUILT) 
r R 


F 

r 


J CCALL] 
R 


10 


=Year-01d Schools 


















1 


Indicator 


59 


59 


51 


51 


62 


62 


58 


58 


2 


Independent School 


04 


60 


04 * 


52 


04 


62 


04 


SS 




Catholic School 


13 




15 




13 




13 






Non -Metro School 


-oa 




-OS 




-OS 




. -OS 




14 


-Year-Old Schools 


















1 


Indicator 


66 


66 


57 


57 


69 


69 


63 


63 


2 


Independent School 


29 


67 


29 


59 


29 . 


71* 


29 


65* 




Catholic School 


14 




14 




14 




14 






Non-Metro School 


-08 




^08 




-08 




-08 





Note : 



Decimal points have been omitted from correlation coefficients. 

Number of schools at lO-year-old/14-year-old levels (weighted) 
- 271/256. 

Confidence limits for correlation- coefficients based on two 
standard errors were *Q,07 for 10-year-old schools, and *0,Q8 
for 14 -year-old schools, (See Table 8,5, footnote cO 

Confidence limits for multiple correlation coefficients were 
taken to be equal to those for correlation coefficients* 
This followed results presented by Ross (1978) concerning the 
similarity of design effects for these two statistics for 
stratified sample designs* 1 

The statistical test for the significance of the contribution 
of the second stage variables /to variance explanation was based 
on the formula, for the F statistic given by thorndike (1978:162) . 
=An— a s t er i s k ~ ( -*-)=ha-s— been— p iacedUb es ideLJt ke„ = R_val ue „f or ^ t 
stage of the stepwise regression analysis to denote that the 
contribution to explained variance at the second stage was 
significantly different from zero at the 95 per cent confidence 
level. 



minimal impact on the difference between the multiple correlations coeff- 
icients and standard error of estimates at each stage. In general the , 
changes in multiple correlation coefficients between stages for all analyses 
were well within the bounds of two standard errors at the 10 -year-old level 
(±0.07) and the' 14-year-old "level (£0.08) . That is, the differences between 
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multiple correlation coefficients between stages were well within the 
limits which could be expected to cover the random sampling fluctuations 
associated with the estimate of any one multiple correlation coefficient. 

These results demonstrated that the Type of School and School Location 
variables were able to add little, or nothing, to the explanation of 
variation in school mean achievement scores 1 ovcr and above 1 the explan- 
atory power of the indicator scores. That is s the information contained 
within these two variables was rendered mostly redundant because it was 
already incorporated in the structure of the indicators. 

This was an important property of the indicators because it demon- 
strated that, if they were to be used in Australia-wide resource alloc- 
ation programs, then schools from different school systems and in different 
locations could be compared directly by examination of their indicator 
scores , 

indicator Stability: Theoretical and Cross Mg 

The preparation of the indicators was based on a least squares procedure 
which used certain combinations of census percentage variables to predict 
school mean Word Knowledge scores. However^ it was known that least 
squares procedures tended to capitalize on relationships that exist within 
particular samples of data* This characteristic has often limited the 
predictive power of composites arising from regression analysis when they 
have been applied to new -samples of data because successive random samples 
from the same population may differ in the nature and extent of the ™ 
relationships among the variables being studied. Thomdike has described 
the tendency for differences to exist between relationships in random 
samples from the same population as 'sample-specific covariation 1 
(Thomdike, 1978:162), 

T M cNemar ( 1969- 2 05) " has" p royi d ed"3 fo rmula which -may be -used to — — - •- ~- •- 
estimate the degree of 'shrinkage \ , in multiple correlation coefficients 
when a regression equation has been applied to new random samples from 
the same population: 

... R 2 - l-(l-R 2 )N-jL y ' 

N-n . \ 

where R z - the ' shrunken f estimate of the multiple correlation coefficient, 
N - the sample size^ * ; ; * t 

R - the observed estimate of the multiple correlation coefficient, 

and ' n = ' the number of variables used in the regression. analysis * y 



When this. equation wan applied to the indicators the resulting 
estimates of shrinkage in the multiple correlation coefficients were 
around 0.01 .for all indicators. For example , the SR(ALL) indicator at 
the 10-year-old level was based on ten linear composites (see Table 7- 3) , 
Also, the sample size was 271 and the observed multiple correlation 
coefficient was 0,71. 

Thus R 2 - l-q-(0,713 2 ) 271-1 

271-11 

" = 0.49 - 
That is, the theoretical estimate of the correlation between the SR(ALL) 
indicator, and school mean Word Knowledge scores for s new sample from the 
same population of 10 -year-old schools was 0,70, 

The estimate of shrinkage in the above formula was derived under the 
assumption of ideal random samples. Under less -than-perfect sampling 

■ conditions this formula provides an estimate of the minimum amount of 
shrinkage which could be expected, Thorndiko (1978) has suggested that a 
more realistic method for establishing the stability of the predictive 
power of a regression equation is to divide the available data into two 
parts and then conduct a 'cross-validation 1 in which the regression 

.equation is developed for the first part of the data and then tested or 
validated on the second part. 

Due to. the limited number of observations available it was not 
possible to divide the data into ! development 1 and 'holdout 1 samples. 
Rather* it was decided to conduct a cross-validation by testing the 
indicators across age levels, The indicators developed at the 10-year- 
old level were tested with the 14-year-old level data and vice-versa. 
This f cross-age 1 validation provided a more demanding test of the stability 
of the indicators as predictors of school mean achievement than the assess- 
men t based on. the the 5 re t real ' formula! * " Fur the r, since the instrument s 
used to measure school mean achievement were different, between age levels* 
this cross -age validation extended the evaluation of the stability of the 
indicators to an even more exacting situation by combining a test of the 
indicators in a sample from a different population with a test of the 
indicators with respect to different instruments used to measure school 
mean achievement, - 

The results of the cross-age validation have been presented in Table 
8, 10. The differences between the correlations in this table and the, 
correlations presented in Table 8,3 provided an assessment of the shrinkage 



Tab 1 e 8 . 1 U l os s - Age Correlations Between School Mean Scores at One Age 
Level and Indicators Developed at the Other Age Level 

School Mean Scores Indicator ____ 

SR(ALL) SR (SOCIAL) SR (BUILT) PC (ALL) 

tO^Year-Qld Indicators Applied to 14-Year-Qld Schools 

-Word Knowledge (14 -Year-Old) 65 61 66 

Literacy (Test 14 R) 61 54 64 

Numeracy (Test 14N) 56 46 64 

Mean Correlation 61 54 65 

14 -Year -Old Indicators Applied to 
Word Knowledge (10-Year-Old) 61 
Literacy (Test 10R) 60 
Numeracy (Test ION) 54 

Mean Correlation . 58 



associated with the application of the indicators to different age samples* 
The correlations were, as expected f somewhat lower when the indicators 
developed at one age level were applied to the sample from the other age 
level. The only exception to this was the SR(BUILT) indicator developed 
at the 10-year-old level. This indicator had higho^ correlations when 
applied to the 14-year=old sample for both school mean Word Knowledge 
and Numeracy scores. 

The SR(ALL) and the SR (SOCIAL) indicators suffered the greatest 
degree of shrinkage for indicators developed at both age levels. This 
was particularly noticeable for these two indicators developed at the 
Jl4=y©ar-p Id level because the, mean correlations * shrunk * from 0.70 to 
0.58, and from 0.64 to 0,51 for the SR(ALL) and SR(SOCIAL) indicators 
respectively/ The SR (BUILT) and the PC(ALL) indicators exhibited a low 
degree of shrinkage for indicators developed at both age levels* The 
SR(BUILT) indicator developed at the 10-year-old level was the most robust 
of all the indicators. This indicator had the same mean correlations when 
applied to either the 10-year-old or 14-year-old samples. 



66 
62 
57 

62 



10-Year-Qld Schools 

^57 58 64 

SO 67 65 

46 61 59 



51 62 65 
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Comjiar isori or Indicator Performance 

In order to make an overall comparison of the performance of the indicators 
a list of seven criteria was prepared* .Five of these described correlat- 
ional properties of the indicators and the remaining two were concerned 
with assessments of the precision with which the indicatory could be used 
for resource allocation . At each" age level the indicators were given a , 
ranking according to their porformance with respect to the seven criteria. 
These rankings have been presented in Table 8:11. 

In the following discussion each of the criteria and the procedures 
used to rank, the indicators have been described. 

Ach i e ve ment Variabl es . The development of the indicators aimed to provide 
composites based on census percentage variables which were highly correlated 
with school mean achievement scores. Therefore * for this criterion, the 
indicators were compared according to thr average of the correlations 
between the indicators and the throe measures of school mean achievement 
in Table 8.5. 

The average correlations were highest at both age levels for the 
SR(ALL) indicator. At both age levels the average correlations then 
decreased in magnitude for the 5P. (BUILT) , PC (ALL) , and SR (SOCIAL) indicators 
The rankings for this criterion have been presented for each age level in 
the first row of Table S.ll. \ 
Social and Learning Han dicaps. Although the indicators were developed tp 
haye high correlations with school moan achievement scores M it was 
considered desirable that they should also be significantly correlated •, 
with certain school behavioural characteristics. The •Social 1 and 
1 Learning* handicaps in Table 8*5 represented a list of behavioural 
characteristics which, if found in high concentrations in certain schools, 
would limit the capacity of these schools to proceed with most . aspects 
of the educational process. The indicators were therefore ranked separately 
for the Social and Learning handicaps according to the average correlations 
between the indicators and the handicaps listed in Table 8.5, \ 

■ ■ * 

The average correlations were very similar for all indicators at each \ 
age level. For example, at both age levels, the average correlations for 
the SR(SOCIAL) and PC(ALL) indicators with Social handicaps were equal to 
the second decimal place. Calculations to the third decimal place were 
therefore carried out in order to obtain the rankings. This similarity 
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Table 8*11 Compari son of Indicator ^ejrfbj*mance _Acco rd in g to Seven 



Crjj^ria__(lQ»_Year-01d Schools and 14 -Year-Old Schools) 



Criterion Indicator 

SR(ALL) SR(SOCIAL) SR (BUILT) PC [ALL) 





10 


I A 


10 


14 


10 


14 


10 


14 


Achievement Variables 


1 


1 


4 


4 


2 


2 


3 


3 


Social Handicaps 


1 




3 


4 


4 


1 


2 


3 


Learning Handicaps 


2 




- 4 


3 


1 


1 


3 


4 


Cross-Age Stability 


5 


3 


4 


4 


1 


2 


2 


1 


Residuals 


°> 


1 


4 




1 


4 " 


3 


3 


Accuracy 


1 


1 


4 


4 


2 


2 


5 


3 


Leakage 


1 


1 


5 


"'■4. 


4 


2 


2 


3 


Mean Rank 


1.6 


1.6 


3.7 


3 J 


> 2.1 




2^6 _ 




In indicator performance 


was 


evident 


throughc 


3Ut 


many of the 


calculations 


carried out to compare the indicators 


on the 


seven criteria 









Cross -A ge Stability , In order for the indicators to be useful for applic- 
ation to schools in general s it vas essential that the strength of the 
relationships between the indicators and school mean achievement scores 
obtained for the 1 development T samples be maintained for different samples 
of schools and different measures of school mean achievement. The 
indicators were compared by considering the average correlations between 
the indicators and school mean Word Knowledge, Literacy and Numeracy 
scores for the 1 cross -age 1 analyses described in Table 8,10, The rankings 
of the indicators were constructed from these average correlations. 

there wis a great 'deal' of similarity in the average correlations for 
the SR(ALL) f SR( BUILT) and PC (ALL) indicators at both age levels, The 
predictive power of the SR (SOCIAL) indicator was considerably loss -than 
the other three indicators at both age levels. 

Residuals , An important characteristic of the indicators was that they 
should be able to be applied to schools in general without recourse to 
the use of additional information concerning special . subgroups of schools. 
The Investigation of residual variation described in Tables 8.8 and 8.9 
demonstrated that negligible gains in predictive power were associated 
with the Type of School and School Location variables , ~ m — " ~" 

. 7 ' ... ; •. , ■ 
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The rankings for thy •Reside /uais T criterion wore based on the average 
of the addltiesrxai contributions tr -to variance explanation in Literacy and 
Numeracy school mean scores whi^h-in occurred when the Type of School and 
School location information was it included in a stepwise regression model 
following the inclusion of each ii indicator. The indicator having the 
smallest mean additional contribu*utions was ranked highest and so on for 
the other indicators, Calculat *Q -ons to the level of OJ.por cent of 
variance were ^required to discern _minate between the performances of the 
indicators on this criterion, ThTTierefore, while the rankings of the 
indicators differed between ag£ t levels it was important to remember that, 
again, the degree of difference between indicator performance was very 
small . . , 

Accuracy and ^ Leakage , The rankings of the indicators" for these two 
criteria wer£ obtained by calculating the average of the indicator 
estimates derived from the the^r fe — etical model for Literacy and Numeracy 
school mean Icom presented ir* * Tables 8,6 and 8,7, 

The ranKi ngs were the san# ■ for the Accuracy criterion at both age 
levels, but di f fercnt for the t^ssakage criterion, The differences between 
the indicators* on these two er£t*^eria were also very small. Within age, 
levels the max: i mum difference Jn m Accuracy Losses and Leakage Losses for 
both Literacy and Numeracy was a ground 2 per cent, and the maximum dif fai- 
ence in the average of these L£§ rases across the Literacy and Numeracy 
criteria was atround 1 .'S per ce/it . 

Overall P er f ord nance « 

The means of the performance rMrarikings of the indicators with respect to 
the seven criteria have been p^sesented in Table 8.11 . At both age levels 
the high mean rankings of the £R5m(ALL] indicator showed that it had the 
best overall performance on th^ssase criteria, In addition it was important 
" to" no t£ that t he SR(ALL] indic^tzrtor had clearly better performance xm ~ the ~ 
most critical areas of these c^t±iteria - the Accuracy and Leakage assoc- 
iatod with precision in resoux^toe allocation to those students who would 
be in most need of assistance. This indicator was therefore selected as 
the 'preferred* indicator of e4ivucational disadvantage among the four which 
had been developed for the ide«trt:i.fication of educationally disadvantaged 
schools in Australia, - ■**..* 
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Summary - 

In this chapter the four indicators of educational disadvantage i, SR(ALL) 
SR(SOCIAL) , SR(BUILT) , and PC (ALL) „ were subjected to a range of analysers 
which were designed to provide a detailed investigation of thoir 
properties. The performance of the indicators was examined in terms of 
their capacity to (1) predict school mean achievement scores (Word Know- 
ledge , Literacy, and Numeracy) and school mean behavioural climate score^^ 
(Social and Learning Handicaps) , (2) maintain predictive power with 
respect to school mean achievement scores when applied to different sample as 
of schools and students, (5) be able £0 bo applied to schools in general 
without recourse to the use of additional information concerning special 
subgroups of schools (Type of School and School location) * and (4) displstay 
high levels of precision (Accuracy and Leakage) associated with the 
identification of students who would be in most need of assistance * 

The overall performance of the indicators across these criteria was 
compared by ranking the indicators for each criterion and then calculators ^£ 

the mean of these rankings. At both age ; levels tho mean ranks of the 

indicators suggested that, with respect to the criteria consideredj the 
SR(ALL) indicator provided the best overall performance. Therefore, thi^ 
indicator emerged as the 'preferred* indicator among the four which had 
been developed for the identification of educationally disadvantaged 
schools in Australia. " 
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CHAPTER 9 



THE 1 MEANING 1 OF TOE INDICATORS: REVIEW OF 
, MODELS OF RESIDENTIAL DIFFERENTIATION 

Introduction 

The indicators which were prepared and examined in the previQUa Rafters 

were based on school neighbourhood information. Their success pre* 

f _ - * 

dietors of both school mean achievement scores and the incidence of 
learning and social handicaps in schools depended* in part, up or* tht 
situation that Australian school neighbourhoods do jary in teFtn£ of 
census-based information, If air Australian school neighbourhoods tod 
exhibited the* same profile of census characteristics then the indicators 
would have had zero correlation with any other variable. In *'a£t 9 if 
this had occurred, then it would have been impossible to const^UQ* the 
indicators because the basic census percentage variables which ^ftafCUlDd 
in their construction would have had zero correlation with the Salmon 
variable used in the scaling procedures. 

The tendency for communities to exhibit differences in geographical 
space has received considerable attention by social science research' 
workers during this century because of the growing availability o£ census 
information and high-speed computers in many countries* This *0$ewch 
has mainly been concerned with attempts to develop models of residential 
differentiation which ' describe the patterns and social dimension assoc- 
iated with observed variations in community characteristics , Iii -this 
chapter a review of these approaches has been presented with aiifi ^f 
selecting a model of residential differentiation which would enable t 
discussion of the mea ning of t he dimensions ^assessed by the indicators to 

be placed within a theoretical framework. ~\ 

, " , 1 J 

The review ini tially summarised features of the 'classics J' pixels 
of residential differentiation which were developed in the Unit#^ States 
during the first half of this century. This (section of the review 
relatively brief for the reason that detailed descriptions of tr^s^del 
and critiques of . their performance have been discussed at length iflth! 
literature (for example, Rob son, 19691 Timms, 1971 ; Murdie, 197£) - Araor 
detailed review of the Shevky-Bell Social Area Analysis model. u£S thon 
undertaken because this model provided an opportunity to evaluate the 



4 =. . 

meaning of the inULQatQfrS in terms of three dimensions of residential 
differentiation which hav^ jjoen shov**«m to exhibit a high degree of 
generality across a range af studie^s and settings* 

• =. 

\lwm Eeple^gy Models 

^ _ _ _ . _ .. 

The word 'ecology* was originally u^ed by botanists and zoologists to 
describe the study of the rolationste^ips of plants and animals to their 
physical environment, Ar^ynd the oa^arly part of this century a group of 
sociologists s led by K*E* Park at ttame University of Chicago, applied 
some of the theories and ^ToNurea /— of biological ecology to the study 
of the growth of cities and thereby established the field of 'human 
ecology 1 (Park^Burgess and NcKeiuiet= , 1925) . ' 5 . 

Certain processes which had hee^n proposed by Darwin and accepted by 
botanists were translated i>y tho ChL _ cage school into human terms* For 
example, they discussed competition Tsetween different population groups 
in terms of area! 'invasion 1 Qvcntua_ily leading to' 'succession 1 
(Burgess, 1925), 

At the centre of the juman ecol ■* ogy model was the assumption that 
the urban environment was ml a randi*wOm collection of buildings and 
people but rather 'a mosaic of 5fleia 2 worlds* C^irth, 1938:2}.' The 
pieces in this mosaic .Vero described, as 'natural- areas 1 each of which 
represented 'a territorial unit whos distinctive characteristics* - 
physical s economic and cultural - the result of the unplanned" opera- 

tion of ecological and spQial precesi^ses ' (Burgess s 1964:458}. / 

• . - : ■ = . , % .' 

In later empirical studios (rev^^ewdll by Robson (1969117-18}} 

researchers began to/ question whethe^a^ the natural 5 area was an acceptable 

unit with which to describe the st**u»c=^ture of human communities. These 

studies demonstrated that "tho identi^tfication of natural areas was 

"dependent "upon the type oi data whitfcn was examined, and also that the 

ecological forces which had boon pror^posed to be instrumental in the 

formation of natural areas hud taken no account of the importance of an, 

individual's sentimental and symbolics attachments to a residential area, 

\ Bur^gf^'Conce nt^^ic Zone Model / 

The investigations of the Chicago eeea^logists associated with the natural 
areas of the city were ^xt^jided by Bttargess (1925} in order to /explain = 




certain spatial pattern;, in the development and community structure of 
urban areas in the United States, The ecological concepts of invasion 
and^uccession were combined into a theory which portrayed urban growth 
as a series of concentric circles surrounding the central business area.- \ 

Burgess (19253 presented two eijarts which; showed five concentric 
circles describing the zones of development in an idealized city and 
the city of Chicago, These zones were defined according to principal 
land usage: (1) Moop' - the central business district, (2) ? 2one in 
transition* - <an originally residential zone which was being subjected to 
invasion by business and industry, (3) 'zone of workingmen ■ s homes' -a 
aone inhabited by workers in industries who have 'escaped' from the inner 
-ones but who desired to live within" easy reach of their work, (4) resi- 
dential zone' - a zone of high class apartment buildings or of exclusive 
districts of single family dwellings, and (5) 'commuters zone' - a zone of 
suburban areas or satellite cities which were within thirty to sixty 
minutes of travel time from the central business district, 

Since the publ ication -of the Burgess model a range, of critiques and 
empirical studies [reviewed by Timms (1971 1218-223} have been carried out 
to assess the theoretical foundations and-, general! zability of the model ^ 
The most severe criticisms emerging from these investigations have been 
that Burgess' zones were merely arbitrary classifications rather than 
•real 1 divisions describing distinct social units, and that the model 
was not applicable to small non-industrial cities. . 

j t . Hoyt's Sector Model 

Hoyt (1939) suggested that the distribution of city neighbourhoods accord 
ing to their social prestige ratings 'was characterized by a tendency to 
follow sectoral patterns emerging from the city centre. The sector model 
accordingly proposed. that different types of residential areas grew out- 
ward along distinct radii, and that new growth on the arc of a given 
sector tended to take on the character of the initial growth in that, . 
sector* 

The sector model was based on Hoyt's examination of average rent 
levels in a large number of cities in the United States. Hoyt presented 
maps of the average rent levels in the cities in order to demonstrate 
that high and low rent neighbourhoods were not aligned concentrically, 
as the Burgess model would have predicted, but rather in a sectoral 
fashion/ Giving prime importance to the high rent sector, Hoyt/ suggested 



that the point of origin of this sector foeussed on the,, location of the 
retail and office centres where members of the population with high 
incomes tended to work. The growth of this sector dominated all others 
as it moved outward from the centre along lines of travel or towards 
another building or trading centre and away from areas of current or 
potential industrial growth. Intermediate level rental areas tended to 
surround the high rental areas on each side. The low rental areas either 
filled in the available sectoral gaps or were Located in whar U£v« once 
high 6r intermediated level areas before the previous residents moved 
outwards in a sectoral fashion. 

Criticism of the floyt model (reviewed by Timms (1971 :227-229) has 
centred on the use of rent as an operational measure of social prestige, 
and also on the vague definition and positioning of sectors within tha 
• model. This latter problem has limited the usefulness of mny subsequent 
attempts to test the generaliaability of the model because researchers 
have, in the absence of a detailed and objective definition of a 'sector' * 
often resorted to the use of arbitrary geometric sectoral divisions of 
the city area, 

Harris and Ullman's Multiple Nuclei Model 

Harris and Ul Iman (1&4E} rejected the concept ofyi single centre of urban 
development which had been a feature of both the zonal and sectoral models 
The number and type of centres or nuclei were considered to vary from city 
to city. However the development of separate nuclei was believed to be 
associated with four common factors i (1) the need for specialized areas } 
for example large scale transportation by rail % water, etc. - t (2) the 
clustering together of industries for mutual benefit, (3) the incompat- 
ability of certain" areas, for example high status residential areas and 
industrial estates , (4) the need_ for storage .and distribution centres 
outside the high-cost central business areas* : 

The multiple nuclei model described a much more, complex pattern of 
urban development than the zonal or sectoral models, It was not a radic- 
_al.Xx different approach ^u.t rather an attempt, to introduce an extra 
feature into the explanation of the nature of urban. development which 
would account for the observed deviation of many cities from these two 
■models* Timms (1071:211) has described this model as f a caveat to thCL_- - 
more general zonal and sectoral models 1 * 

' ' : ; 1 152 1&0 



jiUe^rat !ion_of the Zonal and .Sectoral Models , , 

A great deal of the initial, empirical investigations of the zonal and 
sectoral models of urban structure were concerned with separate tests of 
the utility of each model and each of the models was shown to have limited 
genu ruli lability. Hventually Berry (1965) proposed a multidimensional 
approach to the problem by suggesting that the zonal and sectoral models 
were independent, additive contributors to the total socio-economic 
structuring of city neighbourhoods, , Berry /suggested that residential 
structure could be characterized by axial /variation of -neighbourhoods 
according to socioeconomic rank , and concentric variation of neighbourhoods/ 
according to family : structure , 

The evidence for Berry's proposal /seems to have rested on research 

studies which had employed analysis of variance techniques to assess the 

separate effects of zones and sectors^ in the distribution of social 

characteristics,/ The earliest of these studies appears to have been 

Anderson and Eg© land* s (1961) analysis of the spatial variance of a number 

of socioeconomic measures within fpur cities in the United States. 

Anderson and Egeland used a two-factor analysis of variance design to! 

assess the spatial variation oS^an index /of f social rank f s composed of 

"/ / • . 

occupation and education measures , and an index of 'urbanization 1 s composed 

of measures of family characteristics* iTiie^results of the analyses demon- 
strated that social rank ^aried principally by sector, and urbanization 
by concentric ring J Later studies which had employed similar statistical 



designs obtained similar results, A ran 
reviewed by Murdie (1976:247-258) . 



ge of these studies has been 

/ 



Sheyky and Bell's Social \Area Analysis Model 
. 1 ' \ 

In the' 1950 1 s interest in the theories of^the Chicago school of human 

ecologists began to s wane as sociologists on the West Coast of the United 
States commenced to ^question the assumptionv that the spatial arrangement 
of one city, Chieagq, could be considered ta be typical of urban society, 
The most important cha J 1 this assumption emerged following invest- 

igations of social *vf ■ I . nd residential differentiation in the 
cities of /Los Any : U: *:.*."■ :>.--< \;\u:.»eo (Shevky arid Williams, .1949; Be-1-1 , 
1953; Shevky and / 5 - \ • 

These f socia l u , . /■ * s ■ studies represented a change in emphasis 

fro;n a search for consistent . patterns of urban growth to a concern with 
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the keWsoc ia 1 di incus ions which described residential patterns in geograph- 
ical spaces* Rather than attempt to describe residential structure' in 
terms of ecological processes , . Shevky and his colleagues sought to relate 
the nature and extent of residential differentiation to the social forces 
which were characteristic of society as a whole. 

We conceive of the city as a product of the complex whole of 
modern society; thus the social forms of urban life are to be 
understood within the context of the changing character of the 
larger containing society. (Shevky and Bell, 1955:3) 

The theoretical rationale for the social area analysis approach was 
described in detail by Shevky and Boll (1955), The cornerstone for the 
rationale was the concept; of societal 1 scale 1 , a term which had earlier 
been employed by social anthropologists to describe f the number of people 
In relation and the intensity of these relations 1 (Wilson and Wilson, . 
1«45:25), By combining this concept with Clark's (1051) research into the 
division of labour in society, Shevky and Bell suggested that an increase 
in societal scale was synonymous with the emergence of modern urban- 
industrial society: 

It is our contention that the postulate of increasing scale in 
, modern society gains in analytic utility when we are able to 
specify that in all technologically advanced modern societies 
the most important concomitant of changes in productivity* and 
changes in economic organization with the consequent alterations 
of social relations* has been the movement of working population 
from agriculture to manufacture* and from manufacture '^o commerce * 
communication, transport* and service. (Shevky and Bell, 1955:8-9) 

The effects of increasing societal scale were linked by Shevky and 
Bell to Wirth's (1938) sociological definition of the city in relation to 
population size, population density* and heterogeneity in the social 
composition of the population. However . they challenged his assumption that 
it was the^ city which was the underlying 1 prime mover 1 in the recent trans- 
formation in the scale of Western society. Rather, the 'necessities of 
economic expansion 1 were considered more important because the focus for 
an increase in scale was on the 'total society 1 as well as on cities within 
that society. * 

The . essential features of the social area model have been presented 
in diagrammatic form in Figure 9.1, An increase in societal scale was 
assumed to be reflected in three sets of trends: changes in the distrib- 
ution of skills s changes in the structure of productive activity, and 
changes in the composition of the population. These three trends were 
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is ide red tu U-.ul tu structural reflections of change which can 

be used as factors for the stis*\y of social differentiation and stratifi- 
cation at a particular time in modern society 1 (Shevky and Bell, 1955:4-5) , 
The final step was to'seleet measures which could he used to assess the 
factors (or constructs) labelled 'social rank 1 , 'urbanisation f , and 
1 segregation 1 . The construct labels in brackets in Figure 9.1 refer to 
Bell's (,1955) revised formulation of the original Shevky and Williams 
(1949) labels. 

The first construct 1 social rank 1 , or •economic status 1 , was measured 
by 'occupation' (based on 'the total number of craftsmen, operatives and 
labourers per 1*000 employed persons' (Shevky and Bell, 1955-54)), and 
'schooling' (based on 'the number of persons who have completed no more 
than ^rade school per 1,000 persons 25 years old and over 1 (Shevky and 
Bell, 1955:55)), 'Rent', was later removed from the measurement of the 
social rank construct because it was considered that the rental controls 
introduced by the United States government during the Second World War 
might have affected the validity of rent as an index of social rank. 

The second construct 'urbanization 1 , or ' family status 1 , was measured 
by 'fertility' (based on 'the number of children under 5 years per 1,000 
remains aged 15 through 44 f (Shevky and Bell, 1955:55)) , 'women at work 1 
(based on 'the number of females in the labour force per 1,000 females 
14 years' old and over' (Shevky and Bell, 1955:55), and 'single-family . 
dwelling units' (based on 'the number of single-family dwelling units per 
1,000 dwelling units of all types' (Shevky and Bell, 1955:56) . 

The third construct 'segregation 1 , or 'ethnic status', was measured 
by 'racial and national groups in isolation' (based on the number of non- 
white minority persons, for example Negroes, Mexicans, Cubans, etc, and 
the number of foreign -bom whites, for example Poles, Czechos loyakians , 
Hungarians, etc. (Shevky and Bell, 1955:56-57), > 

= For each of the throe constructs two alternative names were presented 
by Shevky and Bell, The first referred to the. name preferred by Shevky . 
and the second to the name, preferred by Bell, In an appendix to Shevky 
and Bell's (1955 :68) description of how to construct the, three indices, 
each author provided a brief statement in support of his position. 

• Bell emphasised that his preference for the word 'status* did not 
refer-to a prestige connotation . Rather, the word status described 'each 
sub-population's position with respect to each dimension or factor 1 (Shevky 
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and Bull, liif»r» M18) , The main point of disagreement between the authors 
appears to have been associated with the labelling of the second construct 
as either 'urbanization' or 'family status', Bell considered 'family 
status' to be a more limited concept than 'urbanisation' and was both 
closer to the variables which were used in its measurement and more 
easily interpretable , i 

In a later publication Bell (1965) made further modifications to the 
names of the constructs by replacing 'economic status' with 'socioeconomic 
status 1 , 'family status' with 'familism', and f ethnic status' with 
'ethnicity' , These names appeared to be more congruent with the measures 
which were used to construct the indices. In particular, the removal of 
the word 'status' from the names of the second and third constructs 
satisfied the earlier concern expressed by Bell that there should be no 
connotation of prestige associated with these constructs. These later 
label ? have been used in the discussion which follows in this chapter. 

Debate and Evaluation Associated with Shevky and Bell's 
Social Area Anal ysis Model . 

Since the initial publication of the Shevky-Bell social area analysis model 
there has been considerable debate concerning both the theoretical found- 
ations of the model and the generality of the three dimensions of resident- 
ial differentiation, .- 

Theoretical Foundations , The debate in this area has mostly centred oh 
Shevky and Jell's reliance on the concept of 'scale' and their proposition 
that a causal sequence could be established which began with a theory of 
social change, evidenced by changes in 'scale 1 , and ended with a theory 
of residential dif ferentiation ? evidenced by the emergence of the 'socio- 
economic status', ' familism* * and 'ethnicity' dimensions, 

Shevky and Bell's use of the concept of 'scale' borrowed heavily from 
the work of Wilson and Wilson (1945) and, was defined as 'the scope of 
social interaction and dependency 1 CShevky and Bell* 1955:7), However, 
as Timms (1971] has noted, the presentation of the steps in the formation 
of constructs and indices included this meaning as only one of the 'aspects 
of increasing scale r : 



Aspects of Increasing 



Changes in the 
Structure of a 
Social System 



Constructs Derived Measures 



Change in the Range 
and Intensity of 
Relations 



in 



Differentiation 
of Function 



1 exity of 

Organization- 



Chunging Distribution Changes in Arrangement 
'of Skills ■ ■ of Occupations Eased 

on Productive Function 



Changing Structure of Changes ififip of 
Productive Activity Living 



Changing Conspositior. .. Redistribution of the 
of Population ^ Population in Space 



Social lank 
(Economic Status] 



Urbanisation 
[Family Status). 



Segregation 
(Ethnic Status] 



1, Occupation 

2, Schooling 
1 Rent 



Index I 



1. Fertility 
i: Women at Work 
I. Single-Family 
Dwelling Units 



Index II 



L Racial and 
National Groups 
in Relative 
Isolation 



Index III 



Figure 9.1 Steps in the Shevky-Beii Scheme, for Construct FoiBttfonjd Index Construction, 



Source; Soitd an table presented on pap 4 of Shevky and Belly Social Area Analysis Q95S). 




What is l- I so where treated as providing the definition of 
changes in scale is here treated as but one aspect of them. 
It is unclear whether the concept of increasing scale is 
intended to reference an independent set of phenomena 
concerned with social interaction, or whether it is merely 
intended as a general term to describe all those historical 
trends which reflect the change- from traditional agrarian 
forms of social organisation to those characteristic of 
modern industrial society, (Timms, 1971:139) 

tfhile Timms noted some lack of clarity in the way in which societal 
scale was defined and then applied, Nadel (1953) and later Jones (1969) 
pointed out that difficulties of interpretation were also associated with 
the interpretation of this concept provided by the originators of the 
term 'scale 1 . Therefore there seems to have been some degree of inevit- 
ability in the criticism which has been levelled at Shevky and Bell's 
use of the concept. 

Intensive consideration of the nexus between the issues of definition 
and application of the concept of 'scale* has generally been avoided by 
the proponents of social area analysis. It would appear that most authors 
have been content to accept the notion of increasing societal scale as 'a 
, shorthand equivalent for the processes of urbanization, industrialization, 
and modernization' (Jones, 1969 i 17). 

The second aspect of the theoretical development of the Shevky-Bell 
model which received a great deal of criticism was concerned with the 
proposed linkage between increasing societal scale and the dimensions of 
residential differentiation/ Shevky and Bell provided limited evidence 
to support any meaningful linkages between these two societal character- 
istics. For example, they provided no substantial evidence to. explain 
why f a changing distribution of skills' should necessarily result in the 
construct of social rank being 'a significant' differentiating factor among 
individuals and subpopulations in modern society' (Shevky and Bell, 195SU7) 

Critiques by Hawley and Duncan (1957) and Udry (1964) highlighted '.' 
this deficiency in the social area analysis model, Udry extended his 
analysis of the model to suggest that Shevky and Bell's 'theory of 
increasing scale' and their 'theory of subarea differentiation' should be 
considered as separate theories (Udry, 1964:408-409).,. An'attempt by Bell 
and Moskos (1964) to answer these, issues was. presented in the form of a 
simple analogy - but this has generally been considered by experienced 
sociologists to be an inadequate justification (Jones, 1969:18; Timms, 
1971:141) . r ' ' ■ 
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tumcn.s ions of Residential i>i ffc rent i at ion . The debate in this area has 
been concerned with a group of empirical studies . which were carried out 
to cost the Shcvky-Bell hypothesis concerning the dimensions of residential 
differentiation* These studies may be classified into two broad groupings: 
studies which have examined the dimensionality of the variables which were 
used by Shevky and Bell, and studies which have examined the dimensionality 
of these variables in addition to a broader set of variables derived from 
census information, 

(a) Dimensions Asso ciated with the Shevky-jiell Variables , The first 
systematic examination of the dimensions associated with the Shevky-Bell 
variables was carried out by Bell (1955) . This study employed factor 
analysis to examine the intercorrolations among these variables for Los 
Angeles and San Francisco. The centroid technique of factor analysis was 
used to extract three factors which were then rotated to an oblique 
solution, 

The three factors which emerged from these analyses confirmed the 
Shevky -Bo 11 hypothesis that socioeconomic status [with high loadings on 
Occupation * , 'education's and 'rent'), familism (with high loadings on 
1 fertility' , 1 women in the labour force** and J single-family dwelling 
units') s and ethnicity (with high loadings on 'subordinate ethnic groups') 
each represented a 'discrete social factor which was necessary to account 
for the differences between urban subpopulations with respect to social 
characteristics' (Bel 1 , 1955 :46) . 

Inspection of the item-factor correlations ^provided strong support 
for the Shevky-Bell postulate that the indexes selected to measure the 
socioeconomic status and familism constructs formed unidimensional measure- 
ment instruments* 

Van Arsdol et al (1953a) used similar methodology to test the Shevky- 
Bell model for a group of cities in the United States, The results 
confirmed the existence of the three Shevky-Bell dimensions in six out of 
the ten cities which wore examined, The four cities which did not exactly 
fit the model displayed relatively high item-factor correlations with the 
socioeconomic status factor* These cities were found to be located in 
the South of the United States and had high proportions of Negro populations 
Van Arsdol et al proposed that these findings indicated that ! tho range of 
family forms in those [four] cities, as described by the fertility measure, 
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has not become disassociated from social rank 1 (Van Arsdol ot al 1958a- 
2S2) . Timms later hinted that those 'deviant' cities might well reflect 
variations in societal scale within the United States and therefore it = 
was 1 clearly unrealistic to ignore regional differences in mujemi zation 
that may occur within national boundaries' (Tlmms, lt>71-156). 

In a second investigation Van Arsdol et a 1 (1958b) tested the Shevky- 
Bell model by applying factor analysis* to a correlation matrix obtained 
by combining the census information from the ten cities which had been 
examined separately in their first study. The three factors which emerged 
were closely in agreement with the model and the results previously 
obtained by Bell (1955) . 

(b) Dimensions Associated with a Wider Set of Variables , Tryon (1955) 
was the first researcher to employ a wider list o ; Mes than those 

proposed by Shevky and Bell in order to identify i areas. He applied 

a cluster analysis technique to 35 census variable <s to obtain clusters 
of related measures, Examination of the intercorrela wions suggested that 
three dimensions were sufficient to account for the relationships between 
the variables: 'socioeconomic independence 1 s 'family life*, and 'assimi- 
lation', Tryon noted that there was considerable similarity between these 
empirically derived clusters and the throe constructs proposed by Shevky 
and Bell. 

Later reviews (Robsen, 1969 * Rees * 1972) have suggested ~- that there 
was a high degree of subjectivity associated with Tryon's clustering 
decisions and that for this reason his technique has' had limited further 
application* 

Anderson and Bean (1961) also employed a wider group of variables 
to test the generality of the Shevky-Bell dimensions i The study was 
designed to assess whether similar factorial structures to those obtained 
by Van Arsdol et al (195Ba) would emerge if a range of variables in addition 
to the Shevky-Bell variables were included in the analyses. 

The matrix of factor loadings which emerged showed that the socio- 
economic status and ethnicity factors were reproduced but the familism 
factor split into two separate factors. Anderson and Bean labelled these 
two factors as 'urbanisation 1 (which tended to discriminate between apart- 
ment house areas and single family dwelling unit areas) and 'family status 1 
(which tended to discriminate between . areas with different fertility levels) 
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Tho pattern of loadings between these two factors suggested that •urban- 
ization 1 was mostly describing variations in housing characteristics while 
'family status* was mostly describing variations in the social character^ 
i s t i c s of the f am i ly . 

S chm id and Tagashira (liUil) demonstrated that the basic factors of 
socioeconomic status, familism and ethnicity were invariant under the 
condi* ions of change in trie numbers of variables which were employed to 
represent the same community* The three basic factors emerged from factor \ 
analyses of sets of 42* 2l\ 12 and 10 variables which had been used to 
describe the residential structure of the city of Seattle, Further 
analyses carried out by Sweetser (1965) in Helsinki validated this finding 
and prompted the conclusion that 'ecological factors are invariant under 
substitution, addition, and subtraction of variables' (Sweetser, 1965:3793, 

Following the initial use of factor analysis for wider sets of 
variables by Anderson and. Bean there has been a virtual avalanche of 
studies which have applied the same methodology to evex'-growing numbers of 
social settings and variables. An excellent systematic review of these 
studies has been presented- by Rees (1972), Among the studies carried out 
in the United States , Roes found that most identified one socioeconomic 
factor and at least one ethnicity factor (depending on whether ethnic 
.groups were assessed by one or more variables describing ■ minority groups). * 
Most studies also showed some form of familism factor, however there was 
a substantial number of studies ^Ln which two factors bearing some connection 
with this theoretical construct emerged, . j 

In addition to tho emergence of the traditional Shevky-Bell factors, 
many studies obtained factors related to the mobility of the population, 
to the degree of recent migration, and to areas of recent population 
growth. While some suggestions were made that a factor describing these 
processes should be introduced into the 1 triad of Shevky and Bell constructs 1 ^ 
Rees commented that these mobility/migration processes were dynamic in 
nature and would confuse the generally 'static nature' of .the social, 
characteristics of residential structure (Rees , 1972 i 287) , 

Rees attempted to extend his comparative analysis to similar studies 
carried out in places outside, the United States, However certain diff- 
iculties were experienced with the classification of variables into the 
same sets used to describe the United States Studies, These reviews % 
which covered studies carried out in Europe, Canada, Egypt $ and India will 
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not be further U i scussedTbeeause the technical di fficulties of comparison 
led Rees to consider this suction of his summary analysis as 'tentative 
in the extreme* (Rees, 1972:288) . 

A more recent review of 'factorial ecology * studies by Johnston 
(1976) came "to a similar conclusion as Rees with respect to the consistency 
of the Shevky and Bell dimensions? 

By far the major finding, common to a majority of studies, 
irrespective of location and cultural context of the relevant 
— r*°ctTyT°T- s the generality of Shevky and .Bell's three-dimensional 
'model" of the bases to residential area differentiation, 

(Johnston, 1976:217) 

Johnston^also commented that the access ibi 1 ity of high speed computer 
\ facilities which had allowed researchers to employ increasingly larger 
•numbers of variables had not negated the Shevky and Bell model \ Rather, 
these larger scale investigations had added to the model by developing 
aspects, 'which were either overlooked by those authors in their search 
for high-level generalisations or were not relevant to their data sets 
ana* study areas' (.Johnston, 1076:217), 

\ In Australia the first substantial investigation of the social 
dimensions of residential differentiation was carried out by Jones (1969) , 
This study focussed on the city of Melbourne and employed principal 
component analysis to investigate the factor structure of 24 census 
variables describing residential characteristics, Three principal 
components emerged from these analyses- 'SES-Ethnieity ' , ! Famili_sm ? and 
* Nor thiies tern European Settlers f a These three dimensions provided a 
reasonably similar structure to the Shevky-Bel 1 model, however the coal- 
escence of Socioeconomic Status and Ethnicity on the first principal 
component could well have been associated with the orthogonality and 
rotation ^restrict ions placed on the factor structure, Jones (1969) 
rejection of rotational procedures was 'by design , not ignorance 1 because 
he" had structured the analyses on the basis of a priori expectation rather 
than notions of data= exploration, .'■ j , 

A later large-scale investigation of the structure of residential 
differentiation in Austral ianm^ carried out by Logan et _al (1975) , 
Principal component analysis followed by Var^imax rotation of factors was 
employed to separately examine a set of 22 census variables which described 
the Australian State capital cities and the non-motropolitan regions or- 
Australia, -. | ';. - - • " • " 
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I he factor si rucluru u f residential di f forentiat ion of the capital 
cities closely followed the Shcvky~Bcll, model - although some city- 
specific factors also emerged from the analyses, The strongest factors 
to emerge in all cities were 'Socioeconomic Status 1 , !A Factor Identifying 
Differences in Dwelling Types* (which was closely linked to the Familism. 
construct) > Logon e t _a 1 (19753 noted that in most .cities familism was 
divided into two or three separate dimensions, one which identified 
dwelling type variation, one which identified the very recent* high 
fertility, suburban areas, and, in some cases, another which separated 
out the proportion of females in the workforce* 

The factor analyses carried out for the non-metropolitan regions 
employed a different list of census variables and therefore it was not 
possible to compare these results with those obtained for the cities. 
This list of variables was narrowly defined to be 'indicative of standard ? 
of living* or 'quality of life measures 1 (Logan ' et al f 1975*61), The 
factors which emerged from the analyses were, not surprisingly * somewhat 
different from the analyses for cities - and they lacked simplicity of 
structure and interpretation „ 

Summary 

In this chapter a range of models of residential differentiation has been 
reviewed. These models have ranged from yfche early human ecology and zonal/ 
sectoral descriptions of urban growth to/the more recent Shevky-Bell 
proposals concerning a rationale for the/ evolution of three social dimen- \ 
sions which describe residential patterns in geographical space, , 

\ Certain aspects of the theprexicai foundations of Shevky and Bell's 
social -orrezi anaTy" sis model have received considerable criticism. In part- 1 

iciilar* many authors have ; disputed the validity of the implied causal link 

j 

between societal scale and residential differentiation. Some critics J. 
(Johnston* 1971:58; Robson, 1969:52) have even hinted- that there was a ' 
high degree of ex_post_ facto rationalisation in the theoretical exposition 
which Shevky and Bell prm/ided^as ~a justification for the variables and 
indices^wH4--ch tTiey selected as the key measures of social structure. 
Nevertheless j the incidence of their three basic dimensions of residential 
differentiation in studies carried out for different social settings and 
employing a wide range of variables has been consistently established. 




Thv researcher faced with, the evidence of this debate is therefore 
left with a 'theory 1 which has questionable logical structure >and yet 
reasonably firm predictive properties with respect to the nature of 
residential differentiation. The most useful resolution of this difficult 

situation has been presented by Jones (1969) : 

/ ' 

. . I propose to accept Shevky and Bell's discussion of the 
major trends in recent social change not as a formal theory 
dictating the lines of subsequent analysis of urban residential 
- differentiation j but rather as a set of sensitizing concepts 
directing attention to basic forms of social differentiation 
in modern industrial society s a view which seems quite consonant 
.with their original intentions. Seen in this way, postulates 
about increasing societal scale constitute a conceptual scheme 
within which * changes in social differentiation and stratifi- 
cation can be analysed. (Jones, 1969:21) 

The majority of the studies which have investigated the generalize 
ability of the Shevky-Bell dimensions appear to have concentrated upon- the 
use of census data to examine aspects of residential differentiation in 
urban areas. This focus of researchers* efforts on urban environments 
probably has its origins in Shevky and Bell's original use of the cities 
of Saw Francisco and Los Angeles' to present detailed descriptions of 
applications of their theory (Shevky and Bell , 1355) and to provide valid- 
atory evidence for the existence of their three dimensions of residential 
differentiation (Bell, 1955) , ^ < 

A concentration on urban settings was, in Shevky and Bell's view, 
an/ unnecessary constraint on the situations \Xn which their theory could 
be applied: 

To date all the published work util I sing this method has dealt 
with the census tract as the unit of analysis . . , and the major 
focus of interest is the internal differentiation of a 
particular urban area. There is no reason s however^ why a 
typology based on the three social dimensions - social rank, 
urhahiEation 5 and segregation - could not be utilized, with 
different specific measures in the. indexes if necessafyi for 
the study of cities with the city as the unit of analysis, for 
the study of regions, or even* for the study of courttries* 
. . (Shevky. and. Bell, 1955:20) 



In this study the 'preferred' . indicator of educational disadvantage, 
SR(ALL), was developed ^from census data descriptions of the characteristics 
of neighbourhoods surrounding Australian, schools , Therefore, in keeping 
with Shevky and Bell's proposal that their three social dimensions were 
applicable to r units of study beyond census descriptions of urban settings , ' 



\ 

it was decided to ruvrs finite the utility of these dimensions for examining 
the 'meaning 1 of the rank order of schools obtained from the -SR(ALL) 
indicator scores. This invest igation , has been discussed in detail in the 
following chapter. 
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CHAPTER 10 \^ 

■ ; ■ \ 

THE 'MEANING'. OF THE INDICATORS * COMPARISON; OF THE\ 

\ndicator5 wrns thei dimensions of school - 

\ . ■ " : 

NK I QiHOiJiy IOOD RliS i DENTIAL DIFFERENTIATION 



Introduction 



. .i . \ 

The SFtfALL) Indicator was selected as the 'preferred 1 indicator of educate 

ional disadvantage in Chapter 8 because of its better all -round performance 

on sevijn important criteria, In this chapter consideration has been \^iven 

co an invest i gat ion of the meaning of the scores obtained from this \ 



indicator, i \ 

The development of the SH(ALL) indicator was centred around a series 
of stepwise regression analyses which selected subsets of census percentage 
variables to- form linear composites and then combined those in order to \ 
provide an indicator which was maximally correlated with school mean \ 
achievement scores* This procedure was primarily guided by the aim to r 
optimize the predictive power of the indicator scores , Some minor inter- \ 
vention was taken during this procedure to avoid technical problems of \ 
face validity associated with the appearance of suppressor relationships \ 
in ' the regression analyses.l However the overall development strategy 
was not concerned with the fashioning of indicators whose face validity \ 
would fit some current or* past sociological model of causation to the \ 
educational environments of Australian students. 



By way of example, the inclusion of the linear composite describing 
bathroom and kitchen facilities in the SR(ALL) indicator at both age-levels 
occurred because this linear composite added to -predictive power. It was 
noc added because the linear composite fitted some causal model of educat- 
ional achievement concerned with either the effects of washing and cooking 
facilities, or the effects of adequate housing s for which this linear 
composite might have provided a surrogate measure. 

Consequently, when the question f What is tne meaning of the SR(ALLj 
indicator scores?* was posed, there, was some temptation' to retreat to a 
..response couched in terms of the technical procedures used in the 
strategies of indicator construction rather than attempt to answer in terms 
of a description of those social characteristics of school neighbourhoods 
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which were as.M»v: i ;i t vd with the indicator Scores . The difficulties 
involved in providing a s inipU and intelligible answer of the latter kind 
may be readily demonstrated by an inspection of the correlation coeff- 
icients between the indicator scores and the complete set of linear 
composites which were candidates for inclusion in the SR (ALL) indicator, 
Mit'st* eorrvlar ion coefficients have been listed for both age levels in 
fable 10. 1 , 

Although only nine linear composites entered the SR(ALL) indicator^ 
four beuiij common to both age levels* the correlation coefficients ranged 
from moderate to high positive values for all 1 inear composites. It was 
interesting to note that, due to the intorcorrelation among the linear 
composites themselves, there were many linear composi tes 'not included in 
the S K (ALL I indicator which had higher correlations than those which 
w e re i n c I ude d , " 

The pattern of moderate to 1 a r i;e positive correlation coefficients 
for the linear composites included in the SR(ALL) indicator showed that 
the SR( ALL) indicator was a complex dimension related to a wide spectrum 
of school neighbourhood characteristics: occupation* education, industry 
type, country of birth, period of residence, age » type and size of 
dwelling, bathroom and kitchen facilities, and density of living arrange - 
ments. This wide spectrum of characteristics made it difficult, if not 
impossible, to readily deduce a descriptive name for the SR(ALL) indicator 
from the pattern of correlations in Table 10*1 which would f capsuliie the 
substantive nature of the factor" and enable others to grasp its meaning 1 
(Hummel , 1970:474) . 

While simple inspection of the pattern of correlations between the 
SR (ALL) indicator and the- linear composites used in its construction 
provided little assistance in describing the 1 meaning 1 of the indicator, 
;m examination of the groupings of linear composites hinted at the exist- 
ence of three subdimensions within the overall indicator scores which 
paralleled the three Shevky-Bell dimensions. For example j linear composites 
l i 3, 4 S S, S and 9 were concerned" with the occupational and educational 
characteristics of school neighbourhoods and thus "could be linked to the 
Socioeconomic Status dimension; linear composites IT and 12 described 
the country of birth and the period of residence: of the oversea! born ? 
population and could be appropriately linked to the Ethnicity dimension; 
linear composites 6 and 13 described family (marital) stability and age* 
distribution and were therefore associated with. the Familism dimension; 



Table in. I Cori'Vl ;if ions Between the SK( ALL) Indicator and the Linear 
Composite s of Percentage Variables ( 1 0_^Y o ar- 0 1 d School s 
and 14 -Year-Old School si 



Group Source of 
Lin e a r Com po s i t c 



Age Level 

fli-Year-Old 



Included 
In SR(ALL) 



14 -Year-Old 
Included 
in SR{ ALL) 



I, Occupational Status (M) 


44 




GO 


YES 


2. Occupational Status ( V) 


27 




30 




3. Occupat ional Type (MJ 


90 


YES 


. 82 




4, Occupational Type (F) 


S6 


YES . 


82 


YES 


5', Industry Type 


85 -- 


yes 


71 




b. Marital Sterns 


37 




53 


YES 


?. Religion 


54 




C>2 




H. Quiil i f ications (Obtained) 


S3 


yes 


75 




y. Qualifications (Studying) 


. 46 




60 


YES 


^Qualifications (School) 


66 




68 




1 1 , Coun t ry of H i rt h 


b2 


yes. 


64 


YES 


12. Period of Residence 


42 


YES 


28 




13, Age 


39 




50 


YES 


.14. Type of Dwelling 


45 


YES 


02 




"15, Size of Dwelling ■ 


'ST- -- 




11 


YES 


16. Age of Dwelling 




* * 


* * 


-* * 


l/.Bathroom * Kitchen * 


44 . 


YES 


71 


YES 


18* Facilities (Sewerage .etc) 


30 




53 




ID. Vehicles 


ss 




70 




20. Household Class 


55 




58 




21. Density 


ss 


YES 


50 


YES 


2 2. Occupancy 


35 




55 





Not©: a Number of schools" at 10-year-old/l 4-year-old levels [weighted) 
- 271/256. " 

b Decimal points have been omitted from correlation coefficients . 

c There was no linear composite prepared for the Age of Dwelling 
group (See Appendix I), Thih group was therefore excluded .from 
the analyses, "" 

d The correlations for all indicators have been presented in 
Appendix K. , 
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linear ciiir'.t I'uvt '. M. I \ \? ;iud 21 He" s c r fb euT the t y pe'V" si - o, "an d— fa ci 
iiiv : > of the dwel 1 ings and the number" Of inmates pur dwelling - this 
Lttter group of linear construct? also appeared to be linked to the 
! ;mi li sin dimension because they were concerned with aspects of the 
luuisiiu: environment which were of central importance to living arrange- 
ment:. ■ in fa mi ly . 1 i fc . 

1 he observation of these broad groupings led to the postulate that, 
while the SR(AI.L) indicator was based on a complex series of amalgamations 
of many, census percentage variables combined to form linear composites = 
which iii Mini had been combined to form Indicator scores » the meaning of 
the degree of school neighbourhood residential di f ferent i at ion reflected 
bv the indicator scores could be described in terms of relatively more 
simple dimensions associated with the Shevky-Bell model. 

Ihe nia in aiiH of the analyses described in this chapter was, there- 
tore, to investigate whether the scores on the SR(ALL) indicator were 
amenable to a more parsimonious and more readily interpretable description 
in terms of the social characteristics of school neighbourhoods described . 
by the Shevky-Bell dimensions than could be ascertained by simple inspect - 
ion of the indicator's component parts or census correlates. 

The ShevKy^ Bell Model Applied to Australian School Ne ighbourhoods 
The Shevky_>fiell_Mo_del _: The /Scale 1 of Australian Society 

The relevance of the Shevky-Bell model to the pattern of residential differ- 
entiation in Australian society required an examination of those factors 
which were considered to be measures of societal scale. At the core of a 
wide- ranging discission under the heading of 'the primitive idea of scale** 
Shevky and Bell presented the notion of increasing scale as being synonymous 
with the emergence of modern urban^industriai societ)^. It was of some 
interest that Shevky and Bell grouped Australia with the. United States 
and Britain as examples of countries which have experienced the type of 
transformation in the nature of productive activity which they considered 
to be typical of increasing societal scale. The transformation was 
described as a movement of working population from the primary sector 
(agriculture) to the secondary sector (manufacture) and then to the tertiary 
sector (commerce, communication, transport and service). 

The percentages f of the Australian workforce engaged in these three 
sectors during this century has been presented in Table .10.2. The general 
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U st r ituit ion of 


thu Aust ra 1 ian Workforce by 






Occupation I 




tor the Censuses 


11)01 


=1971 . 




- , — _- 






















I ri Jus t ry 








Census Year 












UHjf 




"~TT»2T 




1947 


1954 


. 1961 


1966 


1971 


Pr iina ry 


33 






24 


18 


IS 


12 


11 


9 


Secondary 


L7 


JO 


21 


li* 


2S 


2S 


2S 


28 


25 


Tort iii ry 


5 u 


SO 


55 




55 


5 7 


60 


61 


66 


Note: .1 


Source : 


f.ogan 


et al 


{ 19 75 : IS) 













pattern of the distribution of occupations between 1901 and 1971 was 
i-h;i rao to ri sod by a dramatic '"all in the proportion enghged in the primary 
sector and corresponding increases in the secondary and tertiary sectors, 
By III 7 J the tertiary sector had emerged as the overwhelmingly dominant, 
sector by encompassing two-thirds of the Australian workforce. 

In parallel with the movement of the workforce between sectors, 
Australian society has experienced substantial growth in the percentage of 
the population living in urban settings, This growth has been particularly 
noticeable since the eloseof the Second World War* In 1947 Australia's 
urban population was around 65 per cent of the total population, however 
by 1971 this percentage had increased to around S5 per. cent (Kilmartin 
and Thorns, 19 78 : 16) . 

The urban predominance of Australian society may be further emphasized 
by an examination of the population of Australia's ton largest cities 
listed in Table 10,5, More than 40 per cent of the Austral ian population 
in 197S was located in two cities; Sydney and Melbourne* Further, around 
70 per cent of the population in 19,73 was located in those ten cities, 
In recent year? the emergence of such high growth urban areas as the Gold 
Coast and' AlbLiry-Wodonga will inevitably contribute substantially to the 9 
already largo percentage of Australian population living in urban 
en v i ronmcnts , 

The structure of productive activity, as described by the allocation 
of the workforce among three sectors, and the dominance of the urban mode 
of living provided firm support that Australian society closely fitted 
Shovky and Bell's conception of a „ society which is in an advanced position 
on the spectrum of 'societal scale 1 , This evidence therefore suggested 
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lable \<)< S I'ujni I at inn *»f' the Ten Largest 


Cities in At 


istralia 










- - ■ - , — . — - . . . 

State • City 


City Population 
C'OOO). 


Pn^i-spnf-fifjp pi (~ 
1 L 1 \_ k_ 1 1 L l4 t= \J i. 

Austral ian 
Population 


New South Wale?* Sydney* 


3,155.2 




22.1 


Newcastle 


375,3 




2.6 


Wollongong 


222,0 




1.6 


Victoria Me I bo u rn e- 


2,717.6 




19.1 


dec long 


13D 5 3 




1.0 


Queensland Brisbane 


1 ,004.5 




7.0 


so nth Australia Adelaide 


930.5 




6,5 


Western Austral iu Perth 


864, 9 




6*1- 


Tasmania Hohart 


166.5 




1.2 


Aust rn 1 idn ■ tiiipi t a I Territory Canberra 


234.7 




1.6 . * 


Total tor All Cities 


9,811.0 




68*9 


Note: a Source: Australian Bureau of St a 


tisties (19803 - 




h Figures refer to estimates for 30 
population of Australia was given 


June 197S. The 
as 14 ,248 ,600, 


total 



that the interrelated trends which they have postulated as being character- 
istic of Organisational complexity 1 (changes i n the distribution of 
skills, productive activity and composition of population) should also 
give rise tb their three dimensions of residential differentiation 
(socioeconomic status, familism, and ethnicity). In the following sections 
of this chapter the emergence of these three dimensions has been explored 
with respect to the nature of residential ^differentiation among school 
neighbourhoods. 

The ShuvRy-Bell Models Choice of Variables ■ 

The three Shovky-Bell dimensions' of residential differentiation have 
emerged as stable constructs across a range of social environments. 
However the variables used to measure these constructs have often varied 
considerably between research studies. Different variables from those 
used by Shevky and Bell have been selected often because researchers have 
been limited in variable choice duo to the census data which was available, 
or because- of a desire= to improve and/or extend the list of variables 
which were to be used as measures of the -constructs . 
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ShuvRy and Hell themselves often seemed to be uncertain as to the 
" app rop r 1 a t e ch o i ee of v a r i a b 1 e s 9 In the 1 J) 5 5 mo n o gr a ph wh i e h d o s c r i bed 
the s theory* illustrative application and computational procedures' of 
social area analysis, Shevky and Bell devoted a whole chapter to 'revisions 
associated with the choice and measurement of variables. For o^oifle, the 
1 rent * variable which had been considered an appropriate measure of the 
Socioeconomic Status construct in 1040 was rejected in 19S0 because of 
the rent controls which were instituted in the United States in T_lie fears 
during and following the Second World War, Also, initially the Ethnicity 
construct had been based on ethnic groups which were resident i ally concen- 
trated at a certain level defined by an f index of isolation** later 
applications rejected the selection of groups according to isolation ana 
instead based the measurement on a count of population associated with a 
list of specific national and raci=al groups. 

In Table 10,4 the three constructs and the 'revised 1 variables whi^h 
wer# accepted by Shevky and Hell as suitable measurements have been listed. 
In order to test the utility of the model for describing the dimensions of 
residential differentiation among school neighbourhoods it was considered 
important to attempt to closely follow the measurement procedures suggested 
by these 'revised* variables, An examination of the data which was (Wail** 
able for the description of school neighbourhoods suggested however that 
certain improvements could be made to the selection and measurement of 
variables which would result in closer links between the constructs, as 
described by Bell's 'groupings 1 in column 2 of Table 10,4, and the sslooted 
variables, 

"The decisions which wore made concerning variable selection hnvo been 
listed in column 5 of Table 10.4. These .decisions have been descriM in 
detail in the following paragraphs, 

■1 Socioeconomic Status . It was decided to extend the measureineiit of 
the Education and Occupation variables in order to more closely reflect 
the distribution of societal characteristics inferred by the use of the 
word 'status* in the name of the construct, Accordingly^ rather tlinn { 
follow Shevky and Bell by creating simple proportion measures based on \ 
single classifications of education and occupation groups s two clusters I 
each based on five proportion (percentage) measures were selected in ordejf 
to represent a spectrum of classifications describing education and 
occupation levels, Two linear combinations of those measures were. then 
constructed in order to maximally summarize the variation between' school 
neighbourhoods with -respect to the five measures within each cluster, 



Ihe I no. i r mmbin.ii.ious within the education and occupation clusters 
were ohtan~ — led by using principal component analysis (Hummel, ISfHl^B)* 
Hit' first cr>f the principal components represents a single dimension which 
.laiumt s u i r the most variance among the variables and therefore: 
selected u form the linear coinh i nat ions . The results of. these analyses' 
huve been ^:zp rebuilt ed for each age level in Table 10,5, 

For tn- -uh clusters of variables the variance explained by t^o first 
principal c^romponent was quite large and no other components hM c-Igen 
values ^fec==.iter than one, In the occupation cluster the first Principal 
component c^iccouuted for t>2 and o4 per cent of the variance fof lO^onr- 
Did and 14 — y earmold schools respectively. While in the educatipli cluster 

t iH fn'T r"~r — ' rTne i pal component accounted for 77 and 82 per cent 0 fthe 

i . " " = . ■ * 

variance t ■ 

j Hie i^-ictor loadings listed in Table 10.5 represented the correlations 
between r.ht_ ~* percentage variables and the first principal components. The 
-tftft/upat ion variable represented by the first principal component M high 
positive ccz^rrelat ions with the percentages of the male workforce having 
profess Lc?n5z=ai , admihistrat ive/executive/managemeht * occupations * W l 
negative cx^d r relations were associated with the percentages of t^e pale 
work fore*? K^aving trans port /communication and process/manual/ labouring 
. nccupat ic?n^r^ * The Education variable represented by the first principal 
component ^Siad high positive correlations with the percentages Of the 
population aged 15* years who had completed a higher degree, bachelors 
degrees Ce^r-tiary non-degree qualifications or who had complete the final 
two year- secondary education; high negative correlations w^eossoe^ 

luted with the percentage of persons who had completed their SQh^ in g 
hut had tfOEsnpleted levels which were below the currently expected compulsory 
minimal JuT"v/el of education (level 8) , * , 

The ste— tren^th and direction of the factor loadings were cQfliplctBly 
con o rue *#vrith the construct of Socioeconomic Status which the Occupation 
and fidue^t - ion variables were intended to represent, Therefor^ cheie linemr 
'comb inn t £0fens w^re accepted as more appropriate 'extended 1 va.fi Attics for 
the measUrsssment of socioeconomic status, In the second t^o c°\iM* °f 
Table In ,5 the coefficients and constants required to calculate the first 
principal- w^coraponcnt scores from the percentage variables have been listed ^ 
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Rejected 
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~t!T^rFiTr^iTT7il~TT : 7 vdtich had been rejected by Shevky and Boil during 
their * revisions 1 , was also rejected for the study of school neighbourhoods 
because suitable data were not available for the measurement of this / 
variable, 

2 Fain i-l ism. {he selection of appropriate variables for the measurement 
of this construct has been subjected by researchers to a lively debate. 
Much of the controversy has followed issues associated with the original 
disagreement between Shevky and Bell as to whether the construct should be 
named 'Urbanization 1 or 1 Family Status 1 / 1 Fami 1 i sm ! (Shevky and Bell, -1955: 
■t»K)-. In a later paper Bell criticised Shevky's selection of variables * 
for this construct: 

his J Shevky 1 s j designation contains conceptual elements 
inadequately measured by the items comprising the index 
additional marital and family characteristics probably should 
be added to the index if a better indicator of the family 
life characteristics of census tract populations is desired* 

(Bell, 1965*241) 

Uell*s criticism may be hi ghl icji ted liy_iL consider at Ion of the linkage between 
the Shevky and Bell variable Women in the Labour Force and the construct of 
Fnmilism, The direction in which this variable was scored by Shevky and 
Roll inferred that a high proportion of women in the labour force identified 
areas in which, to use Rell's description from Table 10,4, there would be a 
'lack ,of families'. In the light of more modern attitudes towards the role 
of women in society 4 women's choices of whether to work or not have become 
increasingly associated with motivations for gaining greater self-fulfillment 
and independence. The decision to work has therefore lost its validity as 
an indicator .of the rejection of a family and motherhood oriented role, 
This trend has been recognized and/ 1 received growing- support by empldyers in 
many countries through the introduction of paid maternity leave from work 
and the growing availability of creches at places of work, Further, the ^ 
economic cost of supporting a young family" in recent times has often 
necessitated that *omen continue to work until all children have completed 
their education and have entered the .workforce themselves. That is, they 
often continue to stay in the labour force while the family is intact and 
living under the one roof - and then leave work when the nuclear family 
disintegrates as the children leave to pursue their own careers and life 
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Table *u*..> Principal Cmnponent lector Lo:u.t_ina^_nntl Scare- Coe t fie I en ts 

for the Oceupat ion ^ I: due At ion and fain i Iy S t a h i 1 i i y V a r i a h 1 e s 
ClO^Yenr-Qid Schools and I 1 ~Year_-(.)Uj fkhoo Is) . 



Variable Name/ JRicto_rJ.o;iJin|!« ______ _ j_co ro__C oe f f * c * ^ n jA_ _ 

Percentage Variable lT> - V e a r ^T) i If i f - Y e 7i r - 0 hi 1 0 -Year -Old 14 -Year-Old 



Oecupat ion ' 1 

% OCC TROF (Mj) PI ' 94 ( 06 06 

V Oct! ALIM/EXMC/MAN* (Ml S6 90 06 05 

ua:_t:i.r.Ru:.\i. (Mj - - 58 64 p& 06= 

v OCC TRAN5/C0MN (M) - -77 -75 /-OS f -03 

^ OCC r ROC/MAN/ LAB (M) . .. -69 -74 ' -09 -12 



Percentage of Variance 62 64 

Regression Constant , ■" -20 * -10 



F ducat ion 

1, HI QIER" H OBI" ■ 86 SP 74 . 6i 

% BACH !) OBI iU S3 17 IS 

0 TERT NO OBT , S4 S9 12.12 

1 SCHOOL GT LEV 9 COMPLETE £4 94 03 - 03 



% SCHOOL 'UP It) LKV 7 COMPLETE -73 / -84 -01 . -01 



Percentage of Variance 11 %% - 

Regression Constant * _ -52 -54 



Family stability 

% SEP (EVER MAR M I 5+1 75 ' 85 -18 -20 

% SEP (EVEk MAR FM 15+) 64 - - 85 , -15. -21 

% DIV (EVER MAR M 15+) ' Si 88 -25 -24' 

1 DIV (EVER- MAR FM 15+)- , 81 .78 ^ -24" -2,1 

VWII) (l;VL:R MAR M 15 + ) 77 73 -13 -14., 

% WI!) (EVER MAR FM 15+) / 81 74 . * * -05 -05 



Percentage of Variance -- 56 < 65 

Regression Constant - 250 275 



Note* a Number of schools at lu-year-oid/i4^yea^Gld levels (weighted) • .. f I 
= 271/256, . * — - 

b - Peeimai point* have been omitted from, factor loadings , raw score _J 

coefficients and the regression constants,- - | 

■ c rho score coefficients and constants foi the Family Stability 

variable were reversed in sign so that a high score on this 
variable indicated a high level of family stability, ; 
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■ ,,, tV!M ., m w U , the problems associated with the use of Women In the 

|. ilb ^ur Force a, wasup of the -presence or lack of families' an altern- 
ative variable -wa* prepared as a replacement, This variable was bused on 
the first, principal component extracted from a cluster of six porcenta 8 e 
variable which .sses « .! the deuree of. Family {marltall Stability or 
:;„u' :«■••.-.. following rVli's MunKVXtlon above, it was reasoned Hat a 
suitable set of descriptions of marital characteristics would provide 
,.!,.„! , : -,„.n...m o! areas In which there was a .presence or lack of families. 
Ibo six pere-entaf-e variables described the percent ace-, of ever married 
males or females who were la .years of ace or older and who were separated, 
divorced, or widowed, • , s 

-. 

' |hv results of the principal component analyses have been presented 
in l.ihle 10. r*. l-or this cluster of variables the first principal component 
account, for 58 and Ci5 percent of the variance for the 10 -year -old and 
ll-year-old -chimls respectively. Only the first component s . had eigen 
values greater than one. The score coefficients and constants were 
reversed in s r^rtompH red to those -rfhta ined from the analyses. Thus, a 
hUh' score on the' component associated with- the- family Stability variable 
indicated school neighbourhoods with a low- incidence of marital (and 
hence family) instability caused through separation, divorce, or death. 

The fertility variable employed by Shevky and Bell had close links 
with the construct of" FamLU&n.. This variable was measured by calculating 
. the ratio of the numjer' of children under five years of ago to the number 
of females aged 15 to 44 years, However, the use of this variable would 
have created some conceptual problems when applied to the different age 
samples, J-'ur exarnpl*?," one would expect that school neighbourhoods assoc- 
iated with schools" at the 10-year-old level would have higher fertility 
scores than^sehools at the 14 -year-old level, This difference, would be 
expected. hXause fam lies' in neighbourhoods having many 1 6 -year-olds would 
be more likely to have children under S years old than neighbourhoods 
having many 14 -year-e^ 1 ds . This, difference would not necessarily indicate 
, the 'presence or lack of families* but rather 'reflect t; - agtf.dlf ference m 
in the target popular ions for each sample, 1 ™ j 

The fertility/viiriable was therefore rejected and replaced 'by another 
vdriahle which was considered to have less conceptual problems oft inter- 
^rotation. between the age samples. The selected variable was Separate. 
I louse which was measured by the percentage of occupied dwellings which were 
- separate houses, Th 



s variable was selected to replace Fertility because 
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family ohiut .h i y uf a ^ojuirate home on its owH block of land has become 
an Lute g ra 1 pa r t of t he vit i u o s t rue t u rc of : h A its t r a 11 an f am i I y , Fam i 1 y ; 
ownership of a separate house has been both encouraged and supported try 
Australian governments through low interest housing loans and government 
'grants* to families purchasing their first homes.. The acknowledged and 
K preferred family 1 1 fe-stvLe__j n Aust nil la has boon one* with family life in 
owner-occupied private homes which have Space available for gardens 
(Kilmartin and Thorns, I1J7S 3 . 

Til e S I n £ I e Fa in i 1 y Pwc 1 1 i n g Un i tjs Vj nrihhl £ ?i_ =r ^nlQyed hy_ ^r>d Bell 

was accepted with only .rchnnge i n t^ic* varLabl o m jiaiAo." v The Single Family 
Households variable was measured by calculating the percentage of occupied 
dwellings which contained single family households. ° * 

[ *f i 
-* iitnnijeity. The basic structure of the 5h ^vky-Bel 1 . Segregation Index 

was accepted* except for some slight modifications. Certain categories 'Of 
nationalism! racial groups : Mexicans, French Canadians s Latin Americans 
and Neg rot s , we re n o t re levant to Aust r a ! 1 a a n ci were excluded. Therefore 
the measure of the hthnicity construct was limited to the percentage of the 
totai population horn in nori=fingi ish-speaking Hxaropoan countries, / 

I he Shevk y -_Be_ll Mod el ; 'I-'aerorial Investi^itiorx # /."'"' 

The utility of the Shevky- Be Tl model for the study of 'residential differ- 
ent vat ion associated with school neighbourhoods depended^pon^ts reapacity 
to def ine throe^distinct dimensions s corresponding to the three Shevky- 
Bell constructs, Which would proviffl a meaning if xal basis for the description 
and comparison of school neighbourhoods, 'The original formulation of tlfe 
"model by Shevky and Bell (1955) merely suggest© <3 that the variables thin 
each construct '.grouping' should be simply add^dl TOgether^ following a 
'standardization ' method based on score ranges w C Shevky and Bel 1 , 1955:67-68) 

Rather than accept, these simple summation procedures for the const ruct- 
ion of= the Shevky-Bell dimensions it was^ decided to test the f fit T of the 
postulated constructs to'the school neighbourhood data which were available 
to describe the Vari abl ds purported **to in ensure ^hese constructs, The tech- 
niques on^nTlicLpal component: analysis ami Oblic^ue factor /rotation ^iere 
selected- to) provide empiridal information with respect to theTappropriat'e- 
ness of the variable 'groupings 1 and with respect to the r*<*bor.and nature. ._: 
of the dimensions of school, neighbourhood resident ial differentiation. 

i - • * 
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This factor analytic strategy was similar to the line of argument presented 
in Bell 1 ! (1915 3 initial validatiD—^i study, 

At the fir"St stage oflnvosti gat ion a principal component analysis 
was conducted on the correlations between the six variables described in 
Table 10.4. Since the She vky -Bell- model had postulated the existence of 
three dimensions * the principal cc»mponent solution was constrained to 
extract only thxee components , Th^e component loadings associated with 
each age level nave boon presented in Table 10,6. At the 10-year-old 
and 14 -year-old levels the three c=omponents accounted for 87 per cent and 
90 per cent of 'the variance respect tively, / , . " 

An inspection of the component X loadings in Table 10,6 showed that 
neither a consistent nor a clea?^ £^ trueture emerged across age levels* . 
For examples at the 10-ycaivoid le=vcO . the first component appeared to 
represent a corrifeined socioeconomics status-ethnicity dimension* while at 
the 14- year-old level the first co&rAponent represented an even less clear 
dimension which* combined the socio-economic status, ethnicity and familism 
variables, The> clearest components to emargeat. both age levels was the 
third component which had high pos^itive loadings for the European Bom 
variable and relatively low loadiiimgs for all other variables. 

Since the Shevky-Bcll model iSid not specify that the three constructs 
described orthogonal dimensions ? i_t was decided to conduct an oblique 
rotation of the? principal conipononst solution in order to examine the effect 
of relaxing the? cor;^raint of dlnie=Tisional orthogonality on the structure of 
the factor, loadings , 7 he results of the oblique rotation for each age 
level have been presents! in Table=s 10 J, lo,8 and 10,9, 

The 'obliiriin* method dovelope=d by Carroll (1958) was used to conduct 
the factor rotation* The gamma cr^iterion was set at a very low value of ■ 
0,01 in order to place a premium q»ti the clarity of the factor structure 
without emphasising attempts to hQ~ld the oblique solution near to an 
orthogonal solution. In this senate the derived oblique solution approx= 
imated the f qua.Ttimin f method whic=h was developed by Carroll (195%) as a 
special case of the 'oblimin 1 appr— each for the gamma criterion set at zero. 

The use r ofT oblique factor rot^ation provided three matrices* the 
primary pattern matrix (which repr— esentod the regression coefficients of 
the variables on the factors) , the= primary structure matrix (which repres- 
ented the correlations of the varLables with the factors), and the 
correlation matrix for - the primary— factors," 
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Table 1.0 ,6 Prln eipal Co mpon on t Fa c^or Lo^adin g s for t he Th re e Fac to r 
Solution Obtained frq^m the Six Shevky-Bell Variables 
- 10 -Year-Old Schools and 14-Year-Old Schools* 



Variable 


Principal 


Component Factor 


L- dings 




10-Yeair —Old 




14- 


Year-Old 






I 


□CI 


nr. 


I 


11 


III 


Bducac ion 




©6 


is 


49 


84 


12 


Occupation 


08 


S6 


OS 


56 


80 " 


OS 


Separata House 


84 


-3L9 


10 


78 


"'. -46 


-01 


Family^ Stability = 


87- 


-OS 


.26 


83 


-36 


2S 


Single Family Households 


87 


06 


12 


84 


-26 


ID 


Eyropte&n Bom 


-50 


■^20 


84 


,.-53 


-02 


85 * 


Percera^age Variance 


41 




14 


47 


29 


14 



, Note : a Number of schools at 10-ye»,r-old/14 -year-old levels (weighted) ' 
* . - 271/256, 

b Decimal points have been oi»it ted from factor loadings* 

Tlx<^ key matrix for factor interpretation was the primary pattern ^ 
matrix CRunwml* 19 70:401), This matrix has been presented in Table 10 J* 
It is Lxnportant to note that, since ttie primary pattern factor loadings 
are eqiiivalent to the .corordinates of the variable with respect to the 
primary^ factor axes, tllo absolute val^aes of primary pattern ' loadings may 
exceed m value of 1.00, (Ilummel, i970;^O5) * 

Int comparison to the principal component solution the pattern factor 
. loadings at both age levels provided an extremely clear picture of three ' 
distincrc factors which corresponded dixectly with Shevky and Bell's 
constTut^t:s. The first factor had nigl - * positive loadings on the Separate 
House, Family Stability, .and Single Family Household variables* and almost 
zero le^r^l loadings on all other variaLtsles* This factor^was clearly 
represeiating the f Familism , dimension^ The second factor represented the 
♦Socioeconomic Status' dimension because it had extremely high positive 
loadings on the Education and Occupation variables , and low loadings on 
all oth«3f variables. Similarly, the teJiird factor was clearly the 
•EthnicaL^ty 1 dimension because it had 3. high positive loading on the 
Europeaaca Barn variable and low leadings on all other variables, t 
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Table 10,7 Pat torn Factor Loadings Obtained Following the Qblimin 
Rotation of tho Th^ee -Factor Solution (lQ-Ye.ar-Old 
Schools and 14 -Year-Old Schools) 



Variable 




Pi 


itterri Factor 


Lot 


idin, 












10-Yfcar-Gld 




14 




ir-Old 






. I 


* II 


III 


I 




II 


III 




Education 




98 


06 


*02 




99 


03 




Occupation 


03 


96 


-07 


02 




96 


- -06 




Separate House 


14 


-14 


-05 


85 




-14 


^16 




Family Stability 


94 


" 04 


10 


96 




0.2 


10 




Single Family Households 


86 


10 


^06 


89 




10 


04 




European Born , 


02 


00 


100 


03 




-03 


100 . 





Note: a Number of schools at 1 0-year-old/14 -year -old leVel -(weighted) 
" = 271/256, . . ■ 

b Decimal points have been omitted from factor loadings 

c Factors wore rotated by using the 'dblimin* technique with 
the gamma function set at 0.01 (Rummel , 1970:415), 



A striking feature of the pattern factor loadings across age levels 
was the /similarity in magnitude and direction of the leadings. Many 
loadings had the same value at both age levels and s except for two loadings * 
the difference between particular loadings across age levels did not exceed 
±0 .03. The similarity of the loadings" across age levels showed that, not 
only did the three Shevky-Bell constructs emerge as very clear dimensions , 
but also that the variable weightings for the dimensions measured by the 
primary pattern factors were affectively equivalent for both age groups. 

The primary factor structure matrix' for each age level has been 
described in Table 10.8. The loadings in this matrix indicated that some 
degree of factor intercdrrelation was present. If the factors had been * - 
orthogonal then the pattern and structure matrices would have been equiv- 
alent (Rummel, 1970:399) . The most noticeable feature of the structure 
- matrix at both age <J levels was the relatively high negative 4 correlation 
between the European Born variable and the first -oblique factor which 5 was^ 
• described above as" the *Familism* dimension. This negative correlation 
suggested that s since the .Ethnicity dimension was effectively only measured 
by the: European Bom variable, there would also be a negative correlation 
between. the Familism and Ethnicity dimensions at both age levels. 

^ - - " ■ '. - • ■ ■ ■ ^. 
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*^**fable 10, S Structures Loadings Obtained ^Following the Objimin Rotation 
' of the Three -Factor Solution (10- Year -Old jLchp. ol^gnj ' 
' , ' 14-Year-01d Schools) * 



Variable 






Structure 


Loadings 










10-Year-Old 


14 


-Year- 


^Qld 




I 


II 


.III 


I 


II 


III 


Education 


-07 


97 


-05 


13 


9S 


-14 


Occupation 


03 


97 


-19 


20 


98 


-24 


Separate House' * 


86 , 


-16 




88 


02 . 


-43 


Family Stability 


90 


00 


-22 ' 


93 


16 


-24 


Single Family Households 


8S 


09 


' '■ -36 


89 


24 


= 30 


European Born - "* . 


= 32 


-12 


* 99 


-33 


-20 


99 



Notet. a Number of schools at 10-year-old/ 14 -year-old levels (weighted] 
■ 271/256, ■ . 

b Decimal points have been omitted from factor loadings, 

s c Factors were rotated by using the 1 obi imin 1 technique with 

the gamma function set at 0,01 (Rommel, 1970 :41S) . 

Similarly, the small^loadings of the Education and Occupation variables 
on the Familism factor at the 10-year-old, levnl suggested a degree of 
orthogonality between the Socioeconomic Status factor and the Familism 
factor, The corresponding loadings at the 14 -year-old level inferred a 
small positive correlation between those factors , 

In Table 10,9 the correlations between factors, -within and across age 
, groups * have been presented* Within . each age group the correlations 
between factors have been presented in the upper left-hand matrix and the - 
lower right-hand matrix. The factor intercorrelations support the clues, 
which were given by the structure loadings * At both age levels the 
correlation between the Familism and Ethnicity factors was a moderate 
negative value: -0,34 at the 10-year-old level and -0*36 at the 14-year- 
old level. The correlation between the Socioeconomic Status and Familism 
factors was close to lero at the 10-year-old level and took a small 
positive value of 0*16 at the 14-year-old level. Small negative correl- 
ations q£' -0,12 at the 10-year-old level and -0*11 at the 14-year-old level 
were obtained for the Socioeconomic Status and Ethnicity factors, 
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Tabid 1,0.9 . Correlations Between the Shevky-BeU Dimensions Developed 
. , at Each Age Level (Within an depress rO-Year^Old Schools 

. ' . and 14 -Year-Old Schools)- 



Factor Factor 



10-Year-Qld Factors , i 14-Year^Qld Factors, 
Wocio- " ^Familism Ethnicity Socio- Fami 1 ism Ethnicity 
economic • economic . . . . . . • , 



10-Year-Old Factors 


Applied 


to 10- 


Year-Old 


Schools 






Socioeconomic 


100 








100 


-01 


-ro . ■ 


Fami 1 ism 


-02 




100 




-02 


100 




Ethnic i t / . 


-12 




-34 


100 


. -12 


-35 


? 100 


14-Yeav-Old Factors 


Applied 


to, 14- 


Year-Old 


Schools 






Socioeconomic 


100 




IE 


■i -20 


100 






Fami 1 ism 


16 




100 


-36, 


• 16 1 


100 




Ethnicity 


-18 




-?6 , 


100 


-18 


-36 


ioo 



Note: a Number of schools at lQ-year-Qld/14-year-old levels (weighted) 
m 271/256.'. ! ^ "■ 

b Decimal points have been omitted from correlation coefficients* 
c The correlation coefficients . in the diagonals of the upper r 
. right hand matrix and the lower left hand matrix ranged from , 
0.9966 to 0.9997. * ' \ 

The matrices in the top right-hand corner and lower left-hand corner 
of Table 10.9- have listed the correlations between the 10-year-old factors 
and the 14 -year-old factors scored for 10 -year-old schools; and the 

- correlations between the 14 -year-old factors and the 10 -year-old factors 
scored for 14 -year -old -schools, respectively, "The most interesting 
feature of these mat rices was the unities in the diagonals of these 
matrices. These unities showed that, although the factors had been - 
developed in separate analyses within age groups, they, were measuring 
precisely the same dimensions across age groups. This finding supported 

" the, earlier discussion Ion corning the similarity in pattern loadings 
across the aga levels ' in Table 10.7. 

Some further analyses were conducted to investigate the suitability 
of the "construct names^ attached to the three factors which had emerged at 

-each a ge lev el, A list of variables was prepared which provided inform- 



. at ion. about school neighbourhoods -with respect to socioeconomic, familirsm, 
and .ethnicity characteristics. The correlations between each of the three 
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factors and the variables on, this list wore then calculated. Only variable 
which *h ad not been used in the construction of the factors were listed, , 
Tne correlations between the factors and ,the list of variables at each ag 
level have been presented in Table 10*10* 

At both age levels the Socioeconomic Status factor showed high, posLti 
correlations with the percentages of the female workforce in profession^i t 
administrative/executive/managerial , and clerical occupations,-. This fm%to 
also showed high positive correlations with the percentage of dwellings 
having seven or more rooms. These correlations were supportive of th« n . imu 
which had been give i to the Socioeconomic Status factor because it 
expected that high scores on the factor would also identify school neigh- 
bourhoods' with high concentrations of white collar-professional workfor^ 
members * and with high concentrations of large (and expensive) occupied 
private' dwellings. w 

The correlations between the Familism faetop and the variables seleete 
to describe familism characteristics were also .supportive of the, name given 
to this factor. High positive correlations were obtained between the 
factor and variables describing concentration of children (age ranges of 
0-4 / 5^9, and 10-14) and low to medium positive correlations for the vari- 
able describing the concentration of adults in the 'child rearing r age 
groups' (age range 25-44)* High negative correlations were obtained for- the 
'-.variables describing concentrations of young adults (age range 20-24) and 
alder/retired age level adults Cage ranges 45=64 ? 65+)* .The age profile 
reflected in the pattern of correlations showed that the Familism factor 
formed a dimension which separated school neighbourhoods on the basis of 
age cohorts which reflected the critical years of family life. 

These results were further supported by the correlations between the 
Familism factor and the variables describing the number of inmates* per, 
dwelling. High* negative correlations were obtained for the variables which 
described the concentration of dwellings having only one or twn inmates , - . v 
while positive and high positive correlations were noted for three, four 
or five inmates/ The density-of-.V'-Virig profile reflected in these correl- 
ations showed that the Familism factor was discriminating between living 
arrangements which would be typical of Australian families (two parents 
arid one s two, or three children per dwelling), and living arrangements . 
which would be typical of young adults, broken families, older/retired 
adults (one or' two persons per dwelling), ' ■ . 



Table 10.10 



Correlations Between the Shevky-Bell Dimensions and a 



Subset of Percentage Variables (lO-Year-Old Schools 
• * and 14-Ycar-Qld .Schools} 

Percentage Variable Shevky-Bcll Dimension 

, Socioeconomic Tamil ism Ethnicity 
10 14 : 10 14. 10 14 



S ocioeconomic Descriptors 



% OCC PROF (FM) 


50 


66 


-16 


06 ■ 


-31 


-44 


% OCC ADM/EXEC/MAN (FWJ 


44 


42 


-06 


-03 


-19 


-25 


% OCC CLERICAL [FM) 


60 


5g 


09 


12 


09 


03 


% DWEL: 7+ ROOMS 


49 


66 


-07 


" 14 


-32 


-41 


Familism Descriptors 














% AGE 0-4 (POP) 


-13 


-22 


. 51 


39 


-05 " 


-Or 


% AGE 5-9 (POP) 


-26 , 


-as 


61 


S7 


-19 


-10 


% ACE 10-14 (POP) 


-30 


-05 


4S 


58 


-29 


.-31 


% AGE 15-19 (POP) 


-12 


-11 


-OS 


11 


-04 


-09 


% AGE 20-24 (POP) 


-01 


-14 


-47 


-64 


.:. 38 


39 


% AGE 25-44 (POP) ' " ' \ 


.. 14 


09 


35 




23 


40 


% AGE 45-64 (POP) 


13 


16 


-47 


-35 


1 -06 


-09 


% AGE 65 -K (POP) 


18 


/ 01 


-57 


-42 


-02 


-18 


% DWEL: 1 INMATE 


09 


-OS 


-74 


-71 


04 


-01 


% DWEL I 2 INMATES 


27 


07 . 


-53 


-42 


-06 


-20 


% DML: ' 3 INMATES 


IS 


iy 


16 


14 


18 


16 


1 DWEL:' 4 INMATES 


-02 


20 


68 


60 


OS 


018 


% DWEL: 5 INMATES - 4 


-10 


08 


66 


67 


-06 


-02 


Ethnicity Da-scriptors 














% ? PROTESTANT RE LI G £i 


04 


07 


26 


38 


-49 


-48 


^ CHURCH OF E RELTti 


OS, 


21 ! 


23 


14 


-49 


r -52 


% CATHOLIC RELIG 


-17 


-33 


-IS 


-20 


64 


58 


Note: a Number of schools 


at 10- 


year* 


-old/14 -ye 


iar-old 


level S 





(weighted) - 271/256, 

b Decimal points have been 'omitted from correlation coefficient 

c Confidence limits for correlation coefficients based "on two 
standard errors were *0,07 for 10-year-old schools and *0.08 
for 14-year-old schools (See Table 8,5, footnote c) V 



iSs. 

:i • 199 



The Ethnicity factor was principally dominated by a single variable, 
European Born; and therefore was not subject 'to questions appropriate"' 
labelling as were the other two factors. Ilowovor*, follnwing Jones (I960) - 
approach, several variables associated with religious affiliation wore 
selected as surrogate measures of .the ethnicity of school neighbourhoods* 
The pro file "of correUtiems showed that the Ethnicity factor formed a 
dimension which separated th* religious affiliation typical of many persons 
of Australian/English-born origin (Church of England, Protestant) ■ from the 
religious affiliation typical of many persons of European origin (Catholic) , 

Relationships ' Between the Shevky-Bell 
Dimensions and the SR(ALL) ; Indicator 

Correlational Associations . ■ 

The bivariate relationships between the SR(ALL) indicator, and the three 
Shevky-Beli dimensions were examined by calculating correlation coeff- 
icients. These coefficients have been listed in Table 10.11. The Socio- . 
economic Status dimension had high positive correlations of 0,84 and 0,75 
with the indicator scores , at the 10-year-old. and 14-yeur- i old levels 
respectively. Similar medium sized negative correlations of -0.43 and 
-0.46 were obtained for the Ethnicity dimension at both age levels, The 
Famiiism dimension' showed considerable differences between age levels 
with respect to the magnitude of its correlations with the 3R (ALL) 
indicator: at the 10-year-old level, the Famil ism dimension had a small 
positive correlation of 0/16 with the indicator, but at the 14 -year-old 
level this correlation was a substantially laiger value of 0:46; 

■ At both age levels, the SR(ALL) indicator appeared to be; a complex ' 
mixture of the three Shevky-Bell' dimensions, this complex mixture was - 
dominated by the Socioeconomic Status dimension at the lu-year-old level. 
Whqreas at the 14-year-old level there were relatively more evenly distrib- 
uted associations between the . SR(ALL) indicator and the three dimensions * 

On the final , line of Table 10.11 the multiple- correlation coefficients 
for the Shevky-Bell dimensions as predictors of the SR(ALL) indicator have 
been listed. These high values, of 0,90 and 0.86 for 10-year-old and 14- * 
year-old schools respectively, showed' that the factor assessed by the 
SR(ALL) indicator was almost completely accounted for by the three dimensions 
: cbmbined"Tnto a simple additive model/ Therefore, before proceeding to 
further analysis/ the capacity of these three dimensions in explaining 
variation in school mean achievement scores was compared with the SR(ALL) 
indicator, • j • 



„Table 10. 11 * Corral at ions_ Between the SRCALL) Indicator and the Shevky- 

Sell Dimensions (IQ-Year-Ol'd Schools and 14_-Year»01d Schools) 

Variable ■ Age Level _ • - 

' . - 10^Year-Qld ' 14-Year-Old 



Socioeconomic .Status 


84 




75 ' " ' 


Familism 


16 




46 , • 


Ethnicity 


-43 




-46 


f(s f iV0 ' . * ■ 


90 




,86 



Note; a' Number of schools at i0-year- i eld/14^year-old levels (weighted) 
.■' = 271/256, • , . ^ : 

b Decimal, points have been omitted from correlation coefficients* 

c The variable denoted f(S ? F,E) was the linear^ combination of 
the Shevky-Beir dimensions derived from a regression analysis 
using the SR(ALL) indicator as a criterion variable* * 

The results of these analyses have been presented in Table 10.12, 
The correlation coefficients showed that neither the Shevky-Bcll dimensions 
taken separately, nor in combination as part of a regression analysis* 
provided sufficiently high correlations with school mean achievement scores 
to be considered as rival indicators to the SR(ALL) indicator* \ 

; A feature of this table was the similarity in the pattern of the 
bivariate correlation^ coefficients to those presented for the SR(ALL) 
indicator in 'Table 10, IT; the Socioeconomic Status variable had the highest 
correlations ^ith school mean achievement scores j the correlations for 
the Famil ism' dimension were noticeably smaller at the 10-year-old level 
. than at the 14-year-old^level j the correlations for the Ethnicity dimension 
were similar across age levels and were roughly equal in magnitude to the 
correlations for Famil ism at the 14-year-otd level. "These similarities 
in pattern were expected because the SRCALL) indicator had been constructed 
to be maximally correlated with school mean achievement scores. ■ 

Commonality Associations . r 

Since the three Shevky-Bell dimensions had been derived from oblique factor 
rotations it w;is ; important to interpret their bivariate relationships with 
the SRCALL) indicator in conjunction with the knowledge that there were 
varying levels of association between the dimensions themselves. In order 
to investigate this problem the technique of 1 commonality analysis (Mood, 
1971) was used to examine the 'unique 1 and 'common* components of the 

. . : ; , ■ s; , . ' , . . v--; - y : • :;: 



bivariate relationships between the SR(ALL) indicator—r and the three 
dimensions'. .The formulae required ' for this techniqu^^ have been described 
in . detail by Mayeske et" al (1969) , ' ' \ 

For each dimension the total variance 'explain^ed ■ f represented by 
the* squares of the bivariate correlation coefficient^^ in Table 10,11, t , 
was divided into a unique component, two pair-wise coompdnents, and a 
three ^Way component . The unique, component Vepresent^^d that part of the 
total 'explanatory? power of a dimension which could be attributed solely 
to the particular dimension. The pair-wise componen^^c represented the f 
part which could only be attributed to two dimensions^ jointly and, 
because of the*intercorrolation between dimensions # &could not be 'dis- ' 
entangled*- into separate unique componenft. The thr^ee-way component 
similarly represented the part which could only be^a^ttributed to the three 
dimensions jointly* = ' 

. The results of the eomnipnality analyses, have ba^^n presented in ■ 
Table 10*15, By examining each column of the table was possible to 

identify the unique and common sources of the total ~€^sorreiational assoc- 
iation between each dimension and the SR(ALL) indicl^ttorp * For example, 
at the 10-year-old level, Socioeconomic Status aceouc»ted for a total of 
70 per cent of the variance in "the SR(ALL) indicator^^ This total of 70 
per cent, derived from the square ©f the bivariate ec^Drrelationi resulted ! 
from 65 per cent being uniquely associated with SociesaeeonQmic Status and 
8 per cent in common between Socioeconomic Status anc^^ Ethnicity- ,The 
components which were associated with the common con^^ribution of Socio- 
economic Status and Familism, and the common contribtiition of all three 
dimensions A were both zero, . - 

* At both, age levels the general pattern of resul^Ks showed that the 
. unique contribution of Socioeconomic Status was very large compared with . 
either the unique contributions of Familism and EthnxH,eity or the pair- 
wise and three-way contributions of the dimensions , 

At the 10 -year -old level the total Familism con"^Sribution , of . S ! per cent 
was solely attributable to the common component asfeoc^siated with Familism 
and Ethnicity, ' This result contrasted markedly with the relatively larger 
unique and , common components associated with PamilisraEi for the 14-year-old 
schools. At the 14 -year»old level the unique and coranon contributions of 
Familism and Ethnicity dimensions were almost exactlyv equivalent. At both 



Table 10,12 Correlations, Between the SR(ALL) Indicator, _the Shevky-Bell Dimerisions, and School 
Mean Scores on the Testa of Hord Knowledge, Literacy and Numeracy- (104ear-Qld , 
Schools end 14 -feared Schools) v * 



\ V • 



«5 I 



Ago Level 



10-W-DId 



U*YeaH)ld 



Word knowledge Literacy Numeracy v «ord Knowledge Literacy Numeracy 
(10-y.o, Test) (Test 10R)(Test ION) ' (ityoT. test) (Test 14R]{Te$t 14NJ 



Shevky-Bell Dimensions 



soeloaeonomie Status 



i: 



S 



f(S»F # E) 



59' 

i 

12 
64 



56 
14 
*24 
60 



41 
17 
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< a Number of schools at 10-year-Old/l4-year-old levels (feigned)- 3 271/256.' , 
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' b Decimal points 'hive been emitted froin correlation coefficients' 
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e The variable denoted f(S,F,E) was the linear combination of the* Shevky-Bell dimensions 



derived frgjp a' regression. analysis using school mean achievement sebfes as criterion variables, 
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Table 10.13 Correlational Commonality Table- for the Shcvky-Bell 
; - Drmenslen as ; Prodi ctors of the SR(ALL) Indicator 
- CIQ-Ycar-Old Schools and 1-4 -Year-Old Schools) , . 
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Note? a Number of 1 .schools "'at l^year-old/14-year-old levels (weighieti] 
* ' m 271/256, \ * ; . - 

b All percentages have been^rounded to.whol'c numbers . 9 

$ The symbols S, V, in theVsource of parlance* column refer 
to the three Shevky-Bell dimensions: Socioeconomic Status, 
Farollism* Ethnicity, * " ; 

d The 'Total Variance* referred to the square of the bivariate * 
correlation between the SR(ALL) indicator and, the, Shcvky- 
„ Bel 1\ dimension . * 

age levels "the unique components of the Familism and Ethnicity dimensions 
were sdnilMr to the magnitude , of the components which' they ^had in common 
with the Socioeconomic Status dimension* '.- 

- , Conciqsions and Cautions - '• .- pl . ■ 

' \ - . • . •• • * , - •' * • " , ^ v 

In tilts chapter the three Shevky-Be 11 dimensions ^o # f residential differ- 
entiiJcion ireif Shown ^t© ! be applicable: to the social characteristics of . 
Neighbourhoods surrounding Auitrallan , schools ^ Jhese dimensions facil = 
ita-t^tl an examination of the nature of the complex dimension encapsulated 

*hy tlife SR(ALL) indicator of educational disadvantage 

• < * - " - . • * .•." *.'.' 

11io fiarst stage 'ofi the analyses employed faetoiv analysis 'procedures 

to establish the suitability of the Shevky-Bell v model 5 for describing the 

* ' - * ** ■ * * t ■ ~ ' ■ '- - 

residential differentiation among school neighbourhoods^ ; The similarity ' 
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at both the primary factor patterns and the factor intercorrelations 
across age levels demonstrated the congruence of each of the three Shevky- 
Bell dimensions? for school neighbourhoods surrounding both the 10-year-old 
and 14 -y earmold sample schools. While these results paralleled many 
findings in social geography concerning the factorial structure of 
residential differentiation, some cautions should be expressed with 
respect to the sufficiency of the Shevky-Bell model. 

The very nature of the data collected by census authorities in most 
countries of the world has placed limitations on the types of solutions 
which might emerge from factor analytic invests Rations of residential 
differentiation. The bulk of these data have lerally been collected 
according to content areas which can readily u mped on tjie basis of 
inspection, and without sophisticated multivariate analyses, into the 
same three groupings described by the Shevky-Bell dimensions, Consequently, 
the consistent emergence of the three Shevky=£ell dimensions in a range of 
social settings may well reflect the nature of available data. 

It was therefore possible to postulate, but not .check empirically, 
that the Shevky-Bell model provided three necessary but not sufficient 
dimensions with which residential differentiation among Australian school 
neighbourhoods could be described, Evaluation of this postulate would 
necessitate the collection of larger and more wide-ranging bodies of census 
data - an action which governments would be unlikely to ^support merely in 
order to satisfy the curiosities of social geographers, 

The second stage of the analyses examined the associations between 
the Shevky-Bell dimensions and the- SR(ALL) .indicator of educational dis- 
advantage. These analyses were conducted in "order: to pro vide a^more 
parsimonious and more readily interpret able description of the 1 meaning 1 
of the indicator scores in terms of the social characteristics ~of school 
neighbourhoods described by the Shevky-Bell dimensions than could be 
ascertained' by simple inspection of the indicator's component parts or 
census correlates. 

The results of the second stage of the analyses demonstrated that 
the 5R(ALL) indicator exhibited a complex overlapping pattern of assoc- 
iations with respect to three dimensions of school neighbourhood resid- 
ential differentiation: Socioeconomic Status, Famiiism, Ethnicity* 
This pattern tended to be dominated by the Socioeconomic Status dimension - 



but not to t?ie extent that It was possible to ignore both the Familism 
-and Ethnicity dimensions by labelling the 5R[ALL) indicator as a measure 
of socioeconomic status. Rather, the scores derived from the SR(ALL) 
indicator appeared to represent a summary measure of a network of inter- 
related social features which closely covaried in geographical space 
with school mean achievement levels* This network presented a picture of 
the 'social landscape* surrounding the educationally disadvantaged school 
as one in which there were: 

high concentrations of persons in the economically and socially 
vulnerable position of having low levels of educational attain- 
ment and low levels of occupational skill, 

» low concentrations of persons living according to a popular 

'model 1 of Australian family life characterized by single family 
households^ stable families/marriages ^ and separate dwell ings f 

high concentrations of persons likely to have English language 
communication difficulties because they were born in non -English- 
speaking European countries . 

The interpretation of the results of the second stage analyses must 
be approached with caution in order to avoid the possibility of involve- 
ment with 'ecological fallacies' (Alker, 1969), The 'social landscape' 
described above emerged from the correlational result that the dimensions 
of Socioeconomic Status s Familisnu and Ethnic;! ty displayed the property 
of eovarying in geographical space with scores derived from the SR(ALL) 
indicator. This property enabled a parsimonious description to be made of 
the 'meaning' of the SR (ALL) indicator scores in terms of the dimensions 
=^o£- residential, differentiation among school neighbourhoods. There has 
been no attempt to discuss these relationships at the individual student 
level nor to imply that causal connections might exist between the many 
variables which have been included individually and as composites in these 
analyses* Consequently t the 'social landscape* described above should 
not be treated as being either necessarily characteristic of the particular 
home environments of students who attend- educationally disadvantaged 
schools , or being necessarily a set of causal environmental conditions 
which cause educational disadvantage* 
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CHAPTER 11 



CONCLUSION 



An Outline of the Study 



The main aim of this study was to develop , validate, and describe the 
properties of a national indicator, based on census descriptions of school 
neighbourhoods, which could be used to guide policies designed to allocate 
supplementary resources to educationally disadvantaged schools, 

As the first stage of this study a detailed review was undertaken in 
order to examine resource allocation responses which have been made to 
the changing concept of equality of educational opportunity. As part of 
this review, a description was presented of the structure of indicators 
which have formed integral parts of these resource allocation responses in 
Australia, United States, and United Kingdom. This first stage was 
followed by the development of a theoretical model that examined the 
influence of using indicators to identify educationally disadvantaged 
schools on the accuracy with which resources could be delivered to those 
students who were in need of assistance, 

A program of research, based upon the results of these initial analyses, 
was designed to develop several indicators of educational disadvantage 
which would avoid the inadequacies of many of the currently available 
indicators. These indicators were based on census descriptions of school 
neighbourhoods and they were prepared so as to optimize the correlations 
between the indicators and^ school mean scores on a test of Word Knowledge* 

The performance of these indicators was then compared with resnect. to 
their capacity to (1) predict school mean achievement scores f (2) predict 
the incidence of social and learning handicaps within schools f (5) maintain 
predictive power with respect to school mean achievement scores when applied 
to different samples of schools and students, (4) apply to schools in general 
without the need for supplementary information describing school location 
and school system, and (S) display high levels of accuracy associated with 
the identification of students who were in need of assistance, 

The indicator with the best overall performance was examined with 
respect to the dimensions of residential differentiation associated with 
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the Shevky-Be model. Those analyses were designed to establish whether 
the information obtained from this indicator was amenable to a more readily 
interpretable descriprTon than would be ascertained by simple inspection 
of the indicator's component parts or census correlates. It was demon- 
strated that neighbourhoods associated with educationally disadvantaged 
schools were characterised by an overlapping network of social features 
associated with the socioeconomic status, ethnicity, and family living 
arrangements of the community* 

The Policy Contributions of the Study 

1 T he Nature of Student Variation Within and Between Schools^ and its 
Influence on the Use of Indicators of Educational Disadvantage , 

This study has shown that resource allocation programs, designed to assist 
educationally disadvantaged students, which employ schools as the units of 
identification and funding must take into account the nature of the 
variation in student characteristics within and between schools. 

It was demonstrated that if the distribution of the criterion measure 
of educational disadvantage was mostly associated with variation between 
schools then the majority of educationally disadvantaged students would be 
located in schools with low mean criterion scores, . In this situation, 
resource allocation based on the selection of schools with low mean scores 
would result in an accurate delivery of resources to those students who 
were in need of assistance. Conversely s if the distribution of the 
criterion measure was mostly associated with variation between students 
within schools then all schools would contain similar proportions of 
educationally disadvantaged students - with the result that resource 
allocation to schools with low mean scores would be very inaccurate. 

The nature of student variation irT^AuStral i an schools- was -=£ound— ta-he^ 
more similar to the second of these two extremes when a test of Word 
Knowledge was used as the criterion measure,. For example, estimates 
derived from the theoretical model described in Chapter 3 suggested that * 
the lowest 10 per cent of Australian schools would have 33 per cent of 
their students below the 10th percentile for students, and 20 per cent 
above the SOth percentile for students. 

When compared with a range of developed countries these figures 
suggested that, when a test of Word Knowledge was. used as the criterion 



measure, Australia was a relatively less appropriate setting for resource 
allocation programs which employed schools as the units of identification 
and funding B 

This result did not automatically imply that students would.be the 
most suitable units of identification and funding in Australia because 
the 'gains* associated with increased accuracy in the delivery of resources 
to students who were in need of assistance might be more than offsetby 
the f losses' associated with, for example* pedagogical problems of 
'streaming* which could result from assisting subgroups of students within 
schools, However, this result did indicate that policy makers should be 
aware that the pathway to accuracy in resource allocation was concerned * 
not inly with the use of appropriate indicators but also with the nature 
of the variation of student characteristics within and between schools. 

2 The Development and Eva 1 nation of an Indicator for the _I identification 
of Educationally Disadvantaged Schools in Australia * 

This study has shown ..that it was possible to construct an indicator of 
educational disadvantage ? based on census descriptions of school neighbour- 
hoods, that had a range of properties which were superior to indicators 
currently being used by Australian school systems I This indicator was 
constructed by using stepwise regression analysis in which variables 
describing aspects of both the social and built environments of school 
neighbourhoods were candidates for inclusion in the indicator. 

The use of this indicator to guide .the allocation of resources to 
educationally disadvantaged schools in Australia would be associated with 
a number of important benefits. 

(a) The Construct of ' Disadvantaged ' , The indicator was designed to be 
in close agreement with the definition of 'disadvantaged* employed by the 
Australian Schools Commission to identify schools for participation in 
the Disadvantaged Schools Program (Karmel, 1973:92) . In accordance with 
this definition the indicator (1) was constructed solely from information 
describing school neighbourhoods* and (2) employed a suitable criterion 
measure to ensure that this information described school neighbourhood 
characteristics, associated with a low capacity to take advantage of 
educational ^facilities, 

(bj Statis tical Properties . The analyses which were employed during the 
indicator developmertt and validation phases of the study revealed that = 
the indicator possessed a number of important statistical properties. 
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(i) The predictive power of the indicator with respect to school 
mean achievement scores on a test of Word Knowledge was shown to be 

at least equivalent to an achievement -scaled indicator developed from a 
detailed evaluation of the home environments of students who attend 
Australian schools, 

(ii) The indicator was examined in terms of its capacity to identify 
students who were in most need of assistance in the basic skills of 
Literacy and Numeracy. In particulars quantitative descriptions were 
prepared which summarized the accuracy with which the indicator could be 
used to identify the percentages of students below the 10th and 20th 
percentiles for students on tests of Literacy and Numeracy who were 
attending schools below the IQtft and 20th percentiles for schools on the 
indicator scores* 

For example, at the secondary school level, the lowest 10 per cent 
of schools on the indicator contained 34 per cent of students who were 
below, the 10th percentile for students on the test of Literacy and 17 per 
.cent who were above the. national median on the test of Literacy. These 
two percentages compared favourably with the 1 optimal 1 estimates of 36 
per cent and 17 per cent, respectively, which had been obtained from the 
theoretical model. 

(iii) The development of the indicator was accompanied by a detailed 
examination of important correlational properties of the indicator scores. 
For example, data were presented to show that the indicator (lj was highly 
correlated with school mean achievement scores on tests of Word Knowledge, 
Literacy, and Numeracy, (2) was significantly correlated with measures 
which described the incidence of social and learning handicaps within * 
schools, C3) was highly correlated with a range of census-based descriptions 
of school neighbourhoods which have commonly been seen as being synonymous 
with disadvantage , deprivation, or poverty, and (4) had relatively invariant 
correlational associations with school mean achievement scores when supple- 
mentary information describing Type of School (Government % Catholic* 
Independent) and School Location (Metropolitan, Non-Metropolitan) was added 
to the indicator. ' 

(e) Administrate*^ Properties , The indicator was constructed from census 
data and was based on national samples of Australian schools, These . 
procedures gave the indicator several important characteristics which 
would encourage its acceptance as a national indicator of educational 
disadvantage. q ^ .. 
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(i) The indicator scores were prepared from* simple weighted combin- 
ations of variables constructed from widely available census data* 
Consequently* the construction of an indicator score for a particular 
school would be well witft^R the capabilities of the staff and parents 
associated with Australian schools. This simplicity of construction 

was extremely important because it would minimize -the errors, effort s and 
resources required to prepare indicator scores, and also would enable a 
wider range of people to discuss and debate the -suitability °f the 
indicator for the identification of disadvantaged schools, 

(ii) The indicator scores were prepared irom census data without 
requii/ng the use of personal information which described individual 
students or their families* This characteristic was considered to be 
highly desirable because of the recent concerns being expressed in Australia . 
about the potential threat to personal privacy which has emerged with the 
growing use of computer-stored data banks. 

(i Li) The construction of the indicator scores for all Australian 
schools would require substantially less times resources P and expertise 
in comparison with indicators developed by gathering detailed information 
about students from every school. The main task involved in preparing 
the indicator scores would be the linking of .school catchment areas to 
the appropriate census Collector's Districts* However ^ for the majority 
of schools, this linking operation could be readily carried out by using 
records available at the head offices^of the various school systems. 

(iv) The indicator was prepared from national samples of schools in 
order to facilitate the identification of the most educationally dis^ 
advantaged primary and secondary schools across Australia . This property 
was consistent with the aim of the federal program which was intended to 
* provide assistance to Australia's most disadvantaged schools irrespective 
of their location^ or the school system to which they belonged. 

The Theoretical Contributions of the Study 

1 The Accuracy -Coefficient anji the Leakage Coefficient 

The Accuracy coefficient . and the^eakage coefficient were developed in 
order to make objective assessments *of the accuracy associated with the 
delivery of supplementary educational resources to those students who were 
.. in most need of assistance, For the purposes of comparing. the performance 
of the indicators of educational disadvantage prepared" for this study, 
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the phrase 'those students who were in most need of assistance 1 was 
interpreted to mean 'those students having low scores on tests of basic 
Numeracy and Literacy skills'. However, the application of the concepts 
or Accuracy and Leakage could be extended to other interpretations - 
provided that suitable data were available * Some examples of alternative 
interpretations might be ^hose students having parents with low incomes'^ 
'those students from single parent families', or 'those students living 
in geographically isolated environments'* 

In Australia all of the above examples have at some time received 
high priority' in the development of indicators of educational disadvantage 
In future perhaps a completely new set of interpretations will be selected 
Nevertheless* the importance of the Accuracy and Leakage coefficients 
remains that* once consensus has been reached on a specific set of inter- 
pretations s the indicators may be compared objectively in terms of the 
. nature of the Ltudentfs who are receiving the benefits of supplementary 
resources - These two statistics therefore offer an important avenue for 
avoiding the dangers of ecological or individualistic fallacies (Pogan 
and Rokkan* 1969} which have been inherent in approaches to indicator 
construction based on appeals to the face validity of component variables 
that have been aggregated to the school level or above. 

2 The Dimensions of Residential Differentiation Among Australia 
5c hool Neighbourhoods ' = - _ * 

One of tS& most important findings arising from this— study was that it was 
possible to use information which described the neighbourhoods From "-which 
Australiaii schools obtained their studants to predict school mean achieve- 
ment scores with approximately the same level of precision as may be 
obtained by using detailed information which described the home environ- 
ments of students whe? attend these schools* In both cases the percentage 
of variance explained in school mean achievement scores was around fifty 
per cent* 

This finding was based on correlational associations at the between- 
school level of analysis, Suitable data were not available which would = 
permit statements to; be made as to whether aspects of the social structure 
©f school neighbourhoods would provide independent, contributions to the 
explanation of variation in educational achievement at the between-student 
level of analysis* ^ 



Herbert's detailed review of the literature in this area concluded 
that 'the concept of a neighbourhood effect was intact as a contribution 
of some significance towards the understanding of differential educational 
performance' (Herbert, 1976:153). However, he also emphasized that a 
great deal of the research into the educational significance of a 
•neighbourhood effect 1 should be regarded as incomplete because man/ 
studies lacked rigour in their approach to the development and measurement 
of the dimensions of residential differentiation. 

In this study a detailed investigation was carried out to determine 
whether Shovky and Bell's three dimensional model of residential differ- 
entiation would contribute to an understanding of the nature of residential 
differentiation among Australian school neighbourhoods. It was noted that 
certain aspects of the theoretical foundations of this model had received 
considerable criticism. In particular, some sociologists have questioned 
the validity of the model f s implied causal link between societal scale and 
residential differentiation,. At the same time there has been substantial 
♦research support for the generality of Shevky and Bell's three dimensions : 
Socioeconomic Status, Familism, and Ethnicity. 

The majority of this research support has been drawn from studies 
carried out in urban settings by using census-defined geographic areas as 
units of analysis. Prior to the investigation carried out in this study 
there would appear. to be no published research that has tested the applic- 
ability of the three dimensions when applied to school neighbourhoods which 
were spread across a whole nation. 

The results of this investigation demonstrated that the three Shevky- 
Bell dimensions emerged as distinct factors of residential differentiation 
among school neighbourhoods* In addition, the meaningful ness of the names 
that -Shevky and Bell had associated with these dimensions was established 
by comparison with an independent set of variables which described aspects 
of the social structure of school neighbourhoods* 

It must be conceded that these results did not suggest that the 
Shevky-Be 11 -dimensions represented a sufficient solution for explaining 
residential differentiation among school neighbourhoods. An evaluation 
b£. the sufficiency of these dimensions would require the collection o*= 
more Vide -ranging bodies of data than are currently collected by census 
authorities. However, the .clear emergence of the three Shevky-Bell 
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dimension* in this study provided an extremely valuable framework for 
examining the 1 social landscape* of neighbourhoods surrounding education- 
ally disadvantaged schools* . ? 

In recent years Australian education systems have encouraged local 
community involvement in decisions concerning the management and curriculum 
of schools a These initiatives will inevitably lead to a growing coales- 
cence between each school's educational program and the needs and 
aspirations of its surrounding neighbourhood, Consequently, the method- 
ology and results of the investigation of the dimensions of school neigh- 
bourhood residential differentiation which have been reported in this 
?study should prove to be of considerable importance to, future research 
aimed at understanding the processes and products of Australian schools. 

A including Comment 

The allocution of supplementary" resources in programs designed to alleviate 
the educational consequences of poverty s deprivations or disadvantage has 
required an annua 1 mu 1 1 i -mi Hi on dollar investment in education by govern- 
ments in the United States, the United Kingdom ? and Australia, The 
implementation of these programs has been accompanied by debate concerning 
two main issues * the magnitude of the effects of the programs on part- 
icipating students, and the construction of indicators which would assist 
with decision concerning the delivery of supplementary resources to those 
students whom the programs were intended to assist * 

The first issue has been subjected to a considerable amount of 
research in the United States, The results of this research have not been 
conclusive because several of the key evaluation studies have received 
substantial methodological criticisms with respect to the appropriateness 
of their .criterion measures and the* validity of "their research designs 
when applied to experiments conducted in naturalistic settings, It seems 
that a clear judgement concerning the magnitude of the effects of those 
programs will need to^ await the results of carefully planned longitudinal 
studies* 

In, contrast the second issue has received relatively little research 
Attention* The majority of the work in this, area has been confined to 
reports- which document procedures for the construction of indicators for 
specific programs* These reports have rarely included detailed information 
which describes either the relationships between the indicators and other 
suitable criterion variables, or the characteristics of students who 



receive benefits from these programs. The rationales which have been, 
presented in support of indicator construction procedures have therefore 
often been restricted to arguments that have concentrated on the Face 
validity of the variables used in their construction. Since the indicators 
have generally been constructed from highly aggregated data, and have been 
employed to select groups of students rather than individual students s 
these arguments must be viewed with extreme caution in order to avoid the 
dangers of ecological or individualistic fallacies, 

This study has contributed to the debate on the second issue by 
emphasizing several important points which should be acknowledged during 
the construction of indicators for programs designed to assist students 
who attend educationally disadvantaged schools: 

That the selection of schools rather than individual students 
for participation in these programs places upper limits on the performance 
of indicators in terms of their capacity to deliver resources to those 
students who are in most need of assistance. 

That the upper limits of indicator performance in these programs 
are a function of the variation in student characteristics within and 
between schools, * 

That indicator performance in these programs may be compared 
'objectively ~by using the Accuracy and Leakage coefficients to assess the 
characteristics of participating students, * - 

These three points formed an integral part of the methodology that 
was adopted in this study for the development of an indicator of educat- 
ional disadvantage which would be suitable for Australian" schools * In .- 
addition * analyses were presented which focused on these "three points in 
order to demonstrate that there would be considerable differences between 
ten developed countries in the performance of this type of indicator. 
The differences were shown to originate from differences between the 
countries with respect to the variation of student characteristics within 
and between schools, *" 

In recent years the economic circumstances of many countries have 
resulted in widespread public demands for accountability in government 4 
expenditure. These demands will inevitably challenge the future survival 
of educational programs designed to assist special subgroups of students 
unless it can be v demonstrated that resources have been allocated in an * e 



accurate fashion to the appropriate schools and students. This study has 
described the construction of an indicator that could be used to guide 
decisions concerning resource allocation in Australia - however many 
aspects of the methodology which were employed to develop this indicator 
shou; d prove to be useful for similar programs in other countries. 
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